Search results

MPI run with upto 3xH100 GPU works but starts giving an "illegal memory access" error when run using "mpirun -np 4 ./train_gpt2cu"

Status: Open.

#807 In karpathy/llm.c;

· dm1976-git opened on Apr 17, 2025

[Feature Req]: Any plan on parallel training like deepseeed(zero3, offload nvme) and megatron(tensor parallem, layer pileline)?

Status: Open.

#806 In karpathy/llm.c;

· SeekPoint opened on Apr 16, 2025

Runs under Windows

Status: Open.

#804 In karpathy/llm.c;

· code101015 opened on Apr 14, 2025

Kernel out-of-bounds access in normalization_kernel

Status: Open.

#794 In karpathy/llm.c;

· dndnda opened on Feb 6, 2025

Dataloader shuffle_rng logic bug under multi-gpu settings?

Status: Open.

#792 In karpathy/llm.c;

· codedeft opened on Jan 6, 2025

Token out of vocabulary at train_gpt2.cu:675

Status: Open.

#786 In karpathy/llm.c;

· aidando73 opened on Nov 20, 2024

Online Softmax is wrong

Status: Open.

#776 In karpathy/llm.c;

· NoSavedDATA opened on Oct 4, 2024

Makefile incorrectly finds that <code>nccl</code> is installed for Linux systems with <code>libvncclclient</code>

Status: Open.

#774 In karpathy/llm.c;

· leiDnedyA opened on Oct 2, 2024

Question concerning <code>float4</code>

Status: Open.

#767 In karpathy/llm.c;

· dongrixinyu opened on Sep 25, 2024

[cudnn_frontend] Error: No execution plans support the graph.

Status: Open.

#761 In karpathy/llm.c;

· Necktwi opened on Sep 19, 2024

Will this repo update new documentation later?

Status: Open.

#759 In karpathy/llm.c;

· dongrixinyu opened on Sep 19, 2024

llm.c for inference

Status: Open.

#752 In karpathy/llm.c;

· ztachip opened on Sep 1, 2024