Accenture DumpmediumGenerative AITransformers and Attention Mechanisms

What is the first step in training a Transformer model for a specific task?

A

Initialization

B

Pre-training

C

None of the options given

D

Backpropagation

E

Fine-tuning

Correct answer: Pre-training

Explanation

The source marks the correct answer as: Pre-training.

Related Accenture Generative AI questions

Generative AI primarily aims to:Which of these is NOT typically produced by generative models?Learning a data distribution p(x) allows a model to:Which statement best contrasts discriminative and generative models?Which is a common application of generative AI?Generative AI that helps artists by suggesting concepts is an example of:

Practice more Accenture Generative AI questions

PrimerDumps has 1400+ primer questions, 2026 mocks and coding hands-on — all free.

Generative AI question bank All subjects