...your instinct is yes, which I think is super reasonable. But plenty of ML people are more pessimistic. The best piece I know of on this is by @ajeya_cotra (esp re "the training game"); it's kinda long but you only need the short summary at the top. ...