Two hit compounds (14 and 62) were identified using virtual high throughput screening (vHTS) inhibiting the autophagy process in A2780 ovarian cancer cells. The expression levels of the LC3-II and p62 autophagy marker proteins were monitored using Western blotting. Preliminary structure activity relationship (SAR) study of close structural analogues revealed another active compound 38. The three active compounds were tested in the MCF-7 human breast cancer cells and severe reduction of autophagosomes formation was observed confirming the activity of the inhibitors. The docking scaffold used for the vHTS was a lipophilic cleft on the Atg5 protein, which is occupied by a phenylalanine residue in the Atg16 polypeptide. To the best of our knowledge this is the first report on inhibitors that specifically modulate autophagy by directly inhibiting autophagy specific proteins, which is significant due the role autophagy plays in a number of morbid diseases such as cancer.