Report Artificial Intelligence Computer Science Mathematics Statistics Technology
STEM, Research, EPFL

Hyperparameter Scalings for Transformer Architecture [ Report ]

Go to the profile of Chems Hamdi
Chems Hamdi
Student in electrical engineering , EPFL
Like

Share this post

Choose a social network to share with, or copy the URL to share elsewhere

Share with...

...or copy the link

This is a representation of how your post may appear on social media. The actual post will vary between social networks

I’m looking forward to your feedback, and don’t hesitate to reach out if you have questions.

Go to the profile of Chems Hamdi
Chems Hamdi
Student in electrical engineering , EPFL

Hello, I’m Chems, currently studying at EPFL doing electrical engineering. I recently worked in Professor Chizat’s lab on theory of deep neural networks, specifically on how to scale them optimally.

Please sign in

If you are a registered user on Laidlaw Scholars Network, please sign in

Sign In

Cookies

We and selected partners, use cookies or similar technologies as specified in the cookie policy and privacy policy.

You can consent to the use of such technologies by closing this notice.

Cookie Control

Customise your preferences for any tracking technology

The following allows you to customize your consent preferences for any tracking technology used to help us achieve the features and activities described below. To learn more about how these trackers help us and how they work, refer to the cookie policy. You may review and change your preferences at any time.

See the full cookie policy See the full privacy policy
More information

These trackers are used for activities that are strictly necessary to operate or deliver the service you requested from us and, therefore, do not require you to consent.

More information

These trackers help us to deliver personalized marketing content and to operate, serve and track ads.

More information

These trackers help us to deliver personalized marketing content to you based on your behaviour and to operate, serve and track social advertising.

More information

These trackers help us to measure traffic and analyze your behaviour with the goal of improving our service.

More information

These trackers help us to provide a personalized user experience by improving the quality of your preference management options, and by enabling the interaction with external networks and platforms.