Skip to content

Activity

Showing most recent first

Update install_ort.sh

RyanUnderhillpushed 1 commit to main • 80a647e…199cd1e • 
on Nov 8, 2023

Improve CPU TopP

RyanUnderhillpushed 1 commit to main • 8ef24f7…80a647e • 
on Nov 3, 2023

Python: Merge CPU & CUDA BeamSearch objects to match GreedySearch

RyanUnderhillpushed 1 commit to main • 121c0a7…8ef24f7 • 
on Nov 3, 2023

Big change:

RyanUnderhillpushed 3 commits to main • 284acbe…121c0a7 • 
on Nov 3, 2023

Add LLaMA CUDA support

kunal-vaishnavipushed 1 commit to main • a61b871…284acbe • 
on Oct 26, 2023

Llama Cuda Python Script

RyanUnderhillpushed 1 commit to main • 5dfca50…a61b871 • 
on Oct 26, 2023

Python Llama_Cuda bindings

RyanUnderhillpushed 1 commit to main • 400a2e7…5dfca50 • 
on Oct 26, 2023

Llama demo + Sampling

RyanUnderhillpushed 3 commits to main • be39973…400a2e7 • 
on Oct 26, 2023

Add LLaMA end-to-end example on CPU

kunal-vaishnavipushed 1 commit to main • c0af8ad…be39973 • 
on Oct 20, 2023

Fix some linux build issues

kunal-vaishnavipushed 1 commit to main • 366dcbe…c0af8ad • 
on Oct 20, 2023

Merge branch 'main' of https://github.com/ryanunderhill/generators

RyanUnderhillpushed 2 commits to main • 247bbd0…366dcbe • 
on Oct 17, 2023

Fix small changes for running tests

kunal-vaishnavipushed 1 commit to cpp_17 • 7202b94…cabdd5a • 
on Oct 17, 2023

Get linux build working

kunal-vaishnavipushed 1 commit to cpp_17 • cc345b3…7202b94 • 
on Oct 14, 2023

Test to build in C++17

RyanUnderhillcreated cpp_17 • cc345b3 • 
on Oct 14, 2023

Update README.md

RyanUnderhillpushed 1 commit to main • 4305ffa…247bbd0 • 
on Oct 13, 2023

Python additions:

RyanUnderhillpushed 1 commit to main • 1c56b28…4305ffa • 
on Oct 11, 2023

Rename model stuff to have a more consistent *_cpu or *_cuda suffix.

RyanUnderhillpushed 1 commit to main • 3fc9537…1c56b28 • 
on Oct 9, 2023

Python bindings for CPU

RyanUnderhillpushed 1 commit to main • 9386877…3fc9537 • 
on Oct 3, 2023

Remove absolute path in tests

RyanUnderhillpushed 1 commit to main • b164551…9386877 • 
on Sep 19, 2023

Update README.md

RyanUnderhillpushed 1 commit to main • 0b96f54…b164551 • 
on Sep 15, 2023

Separate project into 2 libraries (the generators and the sample models)

RyanUnderhillpushed 1 commit to main • 8034ea1…0b96f54 • 
on Sep 14, 2023

Remove SafeInt dependancy

RyanUnderhillpushed 2 commits to main • 5fc117e…8034ea1 • 
on Sep 12, 2023

Refactoring the sequences to be cuda specific

RyanUnderhillpushed 1 commit to main • 8b79ac0…5fc117e • 
on Aug 31, 2023

SetLogits now takes a std::span vs an OrtValue

RyanUnderhillpushed 2 commits to main • cbc8502…8b79ac0 • 
on Aug 24, 2023

Remove dead code

RyanUnderhillpushed 1 commit to main • 448fb03…cbc8502 • 
on Aug 24, 2023

Remove now unused files

RyanUnderhillpushed 1 commit to main • 1df051f…448fb03 • 
on Aug 24, 2023

Switch from gsl::span to std::span

RyanUnderhillpushed 2 commits to main • bbc58f9…1df051f • 
on Aug 24, 2023

Cuda BeamSearch now works and passes tests

RyanUnderhillpushed 1 commit to main • 5a076e1…bbc58f9 • 
on Aug 23, 2023

Cmake fixes + build.bat to generate visual studio project vs direct c…

RyanUnderhillpushed 1 commit to main • 7b0a54f…5a076e1 • 
on Aug 17, 2023

Add CUDA build option

RyanUnderhillpushed 1 commit to main • 45eda80…7b0a54f • 
on Aug 10, 2023