+
Skip to content

Question about Project Status and Potential Contributions #1

@Hannibal046

Description

@Hannibal046

Hi Team,

First, I want to express my appreciation for maintaining this repository and fla. I'm finding both projects very valuable.

I have several questions about the project:

  1. Project Status

    • Is this repository actively being developed?
    • Are you accepting external contributions?
  2. Development Direction

    • If external contributions are welcome, could you share your roadmap?
    • I'd be interested in contributing based on the project's goals.
  3. Technical Architecture
    From my understanding:

    • The project uses fla for model definition
    • Training is handled by torchtitan
    • Given fla's HuggingFace compatibility, it should work with lm-eval-harness for evaluation
      Could you confirm if this understanding is correct?
  4. Future Plans

    • Are there plans to extend into post-training scenarios?
    • If so, open-instruct could be a valuable reference point.

Looking forward to your response and potentially contributing to the project.

Best regards

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions

      点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载