His baseline study can be put through criticism due to the amount of ethical issues that weren't looked over. His participants could have suffered Psychological harm if they believed they had administered genuine electric shocks to the confederate participant (the 'learner'.) As well as this, the participants believed their role was random, when they were always going to be chosen as the teacher - in this case they were being deceived by the researcher.
However a strength of his study is that there is further research in favour of his results. Hofling et al, studied nurses in a hospital, and found that 21/22 of them would obey instructions from an authority figure (the doctor) even if they were unjustified. This supports Milgram's results as it shows authority figures are obeyed even in unmoral real life situations.