Advanced Deep Learning and Transformers - Cirrincione
Advanced Deep Learning and Transformers - Cirrincione
Advanced Deep Learning and Transformers - Cirrincione
Program
1. Introduction to deep learning
a. Basic ideas
b. The artificial neuron
c. The Multilayer Perceptron
8. BERT
a. Basic ideas
b. Variants
c. Applications
9. Transformer modifications
a. Modified multi-head attention.
i. Longformer
ii. Reformer
iii. Performer
iv. Big bird
b. Self-attention improvement (Talking heads)
- Way to attend:
In presence - Room T104 building 9 engineering department, UNIPA. Max 40
seats
On-Line – using the following Microsoft Teams channel:
Microsoft Teams meeting
Join on your computer, mobile app or room device
Click here to join the meeting
Meeting ID: 332 870 239 193
Passcode: ztacXU
Download Teams | Join on the web
Or call in (audio only)
+39 02 3056 2266,,805773162# Italy, Milano
Phone Conference ID: 805 773 162#
Find a local number | Reset PIN
Ricevi questa email in quanto sei stato invitato ad una attività/evento/meeting con
l'Università di Palermo
Learn More | Meeting options | Legal