“It has been 2 years of the Gemini program and GDM. Now we have come a great distance in that point with many efforts we should always really feel very pleased with. On the similar time competitors has accelerated immensely and the ultimate race to AGI is afoot. I believe we have now all of the elements to win this race however we’re going to should turbocharge our efforts.
Code issues most — AGI will occur with takeoff, when the Al improves itself. Most likely initially it is going to be with numerous human assist so a very powerful is our code efficiency. Moreover this must work on our personal 1p code. Now we have to be essentially the most environment friendly coder and Al scientists on the earth through the use of our personal Al.
Productiveness — In my expertise about 60 hours per week is the candy spot of productiveness. Some people put in much more however can burn out or lose creativity. Quite a few people work lower than 60 hours and a small quantity put within the naked minimal to get by. This final group shouldn’t be solely unproductive but additionally could be extremely demoralizing to everybody else.
Location — It is very important work within the workplace as a result of bodily being collectively is much simpler for communication than gve and so forth. And, subsequently you could be bodily colocated with others engaged on the identical factor. We have to decrease reporting traces throughout nations, cities, and buildings. I like to recommend being within the workplace not less than each week day.
Group — We have to have clear accountability and group with excessive functioning teams with shared administration and know-how management.
Simplicity — Lets use easy options the place we are able to. Eg if prompting works, simply do this, don’t posttrain a separate mannequin. No pointless technical complexities (corresponding to lora). Ideally we’ll really have one recipe and one mannequin which might merely be prompted for various makes use of.
Excellence — whether or not it’s an eval or a knowledge supply or a dashboard or a message in an inner Ul, please ensure all of them work and all are good.
Pace — we’d like our merchandise, fashions, inner instruments to be quick. Can’t wait 20 minutes to run a little bit of python on borg.
Iterate at small scale — we’d like a lot of concepts that we are able to check shortly. The easiest way to do that is small scale experiments till you may ramp up and hopefully see growing benefit at scale. This is a superb validation. Working an excessive amount of at simply massive scale has a behavior of minor tweaking and overfitting to evals, checkpoint sniping, and so forth. We want actual wins that scale.
No punting — we are able to’t hold constructing nanny merchandise. Our merchandise are overrun with filters and punts of assorted varieties. We want succesful merchandise and [to] belief our customers.“
