To Code, or Not To Code? Exploring Impact of Code in Pre-training

🌈 Abstract

The document appears to be a list of authors for two research papers:

1. "The llama 3 herd of models" by Dubey et al. (2024)
2. "Gemini: A family of highly capable multimodal models" by Gemini-Team et al. (2024)
3. "Bloom: A 176b-parameter open-access multilingual language model" by the BigScience Workshop et al. (2023)

🙋 Q&A

[01] Dubey et al. (2024)

1. What is the llama 3 herd of models? The llama 3 herd of models is a collection of large language models developed by the authors listed in the document.

2. What are the key details about the llama 3 herd of models? The document does not provide any additional details about the llama 3 herd of models beyond the author list.

[02] Gemini-Team et al. (2024)

1. What is the Gemini family of models? The Gemini family of models appears to be a collection of highly capable multimodal models developed by the authors listed in the document.

2. What are the key details about the Gemini family of models? The document does not provide any additional details about the Gemini family of models beyond the author list.

[03] BigScience Workshop et al. (2023)

1. What is the Bloom language model? Bloom is a 176 billion parameter open-access multilingual language model developed by the BigScience Workshop.

2. What are the key details about the Bloom language model? The document does not provide any additional details about the Bloom language model beyond the author list and the model size.