+
Skip to content
View nshkrdotcom's full-sized avatar

Block or report nshkrdotcom

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Maximum 250 characters. Please don't include any personal information such as legal names or email addresses. Markdown supported. This note will be visible to only you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
nshkrdotcom/README.md

Hey there! wave

I'm a software engineer and researcher focused on AI reliability, distributed systems, and functional programming. I build infrastructure for LLM research on the Elixir/BEAM platform.

GitHub followers


microscope Crucible Framework - LLM Reliability Research

I'm the creator of the Crucible Framework, a platform for conducting reproducible experiments on large language model reliability, built on Elixir/OTP.

Key Goal: Building towards 99%+ LLM reliability through ensemble voting and request hedging, with comprehensive statistical testing and transparent causal reasoning chains.

Core Libraries

All published under the @North-Shore-AI organization:

Library Description Stars
crucible_framework Documentation hub & research framework GitHub stars
crucible_bench Statistical testing & analysis (15+ tests, effect sizes, power analysis) GitHub stars
crucible_ensemble Multi-model voting strategies for improved reliability GitHub stars
crucible_hedging Request hedging for latency reduction GitHub stars
crucible_trace Causal reasoning chain logging for LLM transparency GitHub stars
crucible_datasets Unified interface to benchmark datasets (MMLU, HumanEval, GSM8K) GitHub stars
crucible_telemetry Research-grade instrumentation & metrics collection GitHub stars
crucible_harness Automated experiment orchestration & reporting GitHub stars

In-Progress Extensions

Library Description Stars
crucible_adversary Adversarial testing & robustness evaluation framework GitHub stars
crucible_xai Explainable AI tools (LIME, SHAP, feature attribution) GitHub stars
ExDataCheck Data validation & quality library for ML pipelines GitHub stars
ExFairness Fairness & bias detection library for AI/ML systems GitHub stars
LLMGuard AI firewall & guardrails for LLM-based applications GitHub stars

Tech Stack: Elixir, OTP, BEAM VM, Telemetry Research Areas: LLM reliability, ensemble methods, tail latency optimization, statistical testing Status: Active development, v0.1.0 released


rocket Elixir Projects (50 Total)

AI & LLM Infrastructure (20+ stars)

  • json_remedy ⭐ 20 - A practical, multi-layered JSON repair library for Elixir that intelli…
  • axon ⭐ 19 - Axon: Elixir-powered AI agent orchestration, built on the battle-teste…
  • gemini_ex ⭐ 15 - Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio a…
  • ds_ex ⭐ 14 - DSPEx - Declarative Self-improving Elixir | A BEAM-Native AI Program O…

Developer Tools & Infrastructure

  • foundation ⭐ 10 - Elixir infrastructure and Observability Library
  • ex_dbg ⭐ 9 - State-of-the-Art Introspection and Debugging System for Elixir/Phoenix…
  • snakepit ⭐ 8 - High-performance, generalized process pooler and session manager for e…
  • sinter ⭐ 8 - Unified schema definition, validation, and JSON generation for Elixir
  • exdantic ⭐ 8 - A powerful, flexible schema definition and validation library for Elix…
  • DSPex ⭐ 8 - Declarative Self Improving Elixir - DSPy Orchestration in Elixir
  • arsenal_plug ⭐ 2 - Phoenix/Plug adapter for Apex Arsenal framework

AI SDKs & Integration

  • claude_agent_sdk ⭐ 0 - Elixir SDK for Claude AI Agent API - Renamed from claude_code_sdk_elix…
  • playwriter ⭐ 6 - Elixir WSL-to-Windows browser integration
  • pipeline_ex ⭐ 6 - Claude Code + Gemini AI collaboration orchestration tools
  • perimeter ⭐ 6 - Elixir Typing Mechanism
  • jules_ex ⭐ 0 - Elixir client SDK for the Jules API - orchestrate AI coding sessions

Multi-Agent & OTP Systems

  • superlearner ⭐ 5 - OTP Supervisor Educational Platform
  • mabeam ⭐ 4 - Multi Agent BEAM
  • elixir_scope ⭐ 4 - Revolutionary AST-based debugging and code intelligence platform for E…
  • ALTAR ⭐ 4 - The Agent & Tool Arbitration Protocol

Testing & Quality

  • supertester ⭐ 3 - A battle-hardened testing toolkit for building robust and resilient El…
  • sandbox ⭐ 3 - Isolated OTP application management system for Elixir/Erlang
  • cluster_test ⭐ 3 - Distributed Erlang/Elixir test cluster management via Mix tasks

Cloud & Edge Computing

  • cf_ex ⭐ 3 - Elixir libraries for Cloudflare edge computing services. Battle-tested…
  • arsenal ⭐ 3 - Metaprogramming framework for automatic REST API generation from OTP o…
  • apex_ui ⭐ 3 - Web UI for Apex OTP supervision and monitoring tools
  • apex ⭐ 3 - Core Apex framework for OTP supervision and monitoring
  • ElixirScope ⭐ 3 - AI-Powered Execution Cinema Debugger for Elixir/BEAM
  • AutoElixir ⭐ 3 - AI Multi Agent Swarms in Elixir

Utilities & Tools

  • youtube_audio_dl ⭐ 0 - Download high-quality audio from YouTube as MP3 files using Elixir. Fe…
  • tools ⭐ 0 - Elixir repository
  • ex_cloudflare_phoenix ⭐ 0 - Cloudflare Durable Objects and Calls for Phoenix Framework
  • Citadel ⭐ 0 - The command and control layer for the AI-powered enterprise
  • Assessor ⭐ 0 - The definitive CI/CD platform for AI Quality.
  • AITrace ⭐ 0 - The unified observability layer for the AI Control Plane

Crucible Framework (North-Shore-AI)

  • crucible_trace ⭐ 0 - Structured causal reasoning chain logging for LLM transparency
  • crucible_telemetry ⭐ 0 - Advanced telemetry collection and analysis for AI research
  • crucible_hedging ⭐ 0 - Request hedging for tail latency reduction in distributed systems
  • crucible_harness ⭐ 0 - Experimental research framework for running AI benchmarks at scale
  • crucible_framework ⭐ 0 - CrucibleFramework: A scientific platform for LLM reliability research …
  • crucible_ensemble ⭐ 0 - Multi-model ensemble voting strategies for LLM reliability
  • crucible_datasets ⭐ 0 - Dataset management and caching for AI research benchmarks
  • crucible_bench ⭐ 0 - Statistical testing and analysis framework for AI research
  • crucible_adversary ⭐ 0 - Adversarial testing & robustness evaluation framework
  • crucible_xai ⭐ 0 - Explainable AI tools (LIME, SHAP, feature attribution)
  • ExDataCheck ⭐ 0 - Data validation & quality library for ML pipelines
  • ExFairness ⭐ 0 - Fairness & bias detection library for AI/ML systems
  • LLMGuard ⭐ 0 - AI firewall & guardrails for LLM-based applications

chart GitHub Stats

GitHub stats

Top Languages


tools Tech Stack

Languages: Elixir, Erlang, Python, JavaScript/TypeScript, Rust Frameworks: Phoenix, OTP, FastAPI, React Specialties:

  • Distributed systems & fault tolerance
  • AI/LLM infrastructure & reliability
  • Functional programming & metaprogramming
  • Statistical analysis & experimental design
  • Developer tools & productivity

Platforms: BEAM VM, AWS, GCP, Cloudflare Workers, Edge Computing


document Current Focus

  • microscope Research: LLM reliability through ensemble methods and statistical testing
  • building Building: AI infrastructure on Elixir/OTP
  • learning Learning: Advanced OTP patterns, distributed systems optimization
  • growing Growing: The Crucible framework ecosystem

globe Connect


lightbulb Philosophy

"Build infrastructure that researchers and engineers actually want to use. Make reliability measurable. Make experiments reproducible. Make the BEAM shine for AI workloads."


target Open to

  • collaboration Collaboration on Elixir AI tooling
  • consulting Consulting for distributed systems & AI infrastructure
  • speaking Speaking about LLM reliability, Elixir/OTP, or functional programming
  • research Research partnerships in AI reliability & distributed systems
  • open source Open source contributions - PRs welcome on any project!

lightning Fun fact: All Crucible framework commits are co-authored with Claude AI!


Last updated: 2025-10-10

Pinned Loading

  1. gemini_ex gemini_ex Public

    Elixir Interface / Adapter for Google Gemini LLM, for both AI Studio and Vertex AI

    Elixir 15 6

  2. snakepit snakepit Public

    High-performance, generalized process pooler and session manager for external language integrations. Orchestrates and supervises languages like Python and Javascript from Elixir.

    Elixir 8 2

  3. DSPex DSPex Public

    Declarative Self Improving Elixir - DSPy Orchestration in Elixir

    Elixir 8

  4. perimeter perimeter Public

    Elixir Typing Mechanism

    Elixir 6

  5. ALTAR ALTAR Public

    The Agent & Tool Arbitration Protocol

    Elixir 4

  6. arsenal arsenal Public

    Metaprogramming framework for automatic REST API generation from OTP operations

    Elixir 3 1

点击 这是indexloc提供的php浏览器服务,不要输入任何密码和下载