Dark Mode

Skip to content

Navigation Menu

Sign in
Appearance settings

Search code, repositories, users, issues, pull requests...

Provide feedback

We read every piece of feedback, and take your input very seriously.

Saved searches

Use saved searches to filter your results more quickly

Sign up
Appearance settings
SulRash
Follow

Sultan SulRash

Research engineer @AdaMLLab at KAUST

Block or report SulRash

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user's behavior. Learn more about reporting abuse.

Report abuse
SulRash/README.md

Homepage

Pretraining language models :)

Pinned Loading

  1. AdaMLLab/tokenbeast AdaMLLab/tokenbeast Public

    Rust variant of tokenmonster with python hooks and bindings included

    Rust 1

  2. KellerJordan/modded-nanogpt KellerJordan/modded-nanogpt Public

    NanoGPT (124M) in 2 minutes

    Python 4.8k 660

  3. AdaMLLab/FlashFusedMoE AdaMLLab/FlashFusedMoE Public

    A fast, fused, expert parallel optimized mixture of experts library

    Python 1

  4. deepspeedai/Megatron-DeepSpeed deepspeedai/Megatron-DeepSpeed Public

    Forked from NVIDIA/Megatron-LM

    Ongoing research training transformer language models at scale, including: BERT & GPT-2

    Python 2.2k 370

  5. AnshulSood11/Engagement-Level-Prediction AnshulSood11/Engagement-Level-Prediction Public

    Engagement Intensity Prediction in Real TIme

    C++ 17 8

  6. EasyRogue-2 EasyRogue-2 Public

    EasyRogue reincarnated better!

    Python 1