HI @zsef123
Great work!
You said in another issue that you are gonna implement the stochastic depth. Just a quick note that original Efficient Net uses linear schedule which is the same as the Stochastic depth paper, where Layer 0 has drop rate 0 and the last layer has drop rate 0.2.

Thank you!