Rebase to main

…nd add new bash scripts for pretraining and finetuning

…culum and add new bash scripts for 50k training

…aining and evaluation settings

…s with updated model settings

…aining and evaluation on gollie test sets

…a3 model

… model

… and configuration for 50k pretraining of Llama3 model

…s; adjust GPU allocation for 40k evaluation

… for merging before inference

…tuning and pretraining settings for 40k evaluation

…re proper torch_dtype formatting

…tions in dataset.py

… features

…ns for GoLLIE-8B Llama3 splits

…ining and evaluation across multiple seeds. Introduced GUIDEX pipeline for generating annotations and updated pretraining configurations for improved performance.

…environment variable, ensuring better security and flexibility. Added error handling for missing token.

…IDEX, ensuring proper exclusion during version control.