Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!

Griffin: Mixing Gated Linear Recurrences with Local Attention for Efficient Language Models

Vision Transformers Needs Registers. And Gated MLPs. And +20M params. Tiny modality gap ensues!

A GPT Model To Generate Text

"The 'Activation Functions' project repository contains implementations of various activation functions commonly used in neural networks. "

Annotated vanilla implementation in PyTorch of the Transformer model introduced in 'Attention Is All You Need'.

Here, we will provide a PyTorch regime to handle the partial differential equation solution of the heat equation by executing Deep Kolmogorov Method of Beck et. al.

PyTorch implementation of normalization-free LLMs investigating entropic behavior to find desirable activation functions

This repository contains the code and the report for the coursework of INFR11031 Advanced Vision, a postgraduate course offered at The University of Edinburgh. The task was to train on limited and improve the accuracy of the ResNet-50 classifier on a small subset of the ImageNet dataset containing 50K training images and 50K test images. Achieve…

Implemented GPT from scratch

Microphone Array-Based Direction of Arrival of Gunshot Detection .Gun violence remains a critical concern. Identifying the precise location of a gunshot—or getting as close as humanly possible—is crucial for saving lives and ensuring public safety.