Skip to content

Adding LLM support with peft +quantization (4bit and 8 bit) #1631

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
wants to merge 37 commits into
base: develop
Choose a base branch
from
Open

Adding LLM support with peft +quantization (4bit and 8 bit) #1631

Show file tree
Hide file tree
Changes from 33 commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
b8abdef
Update trivy.yml
rajithkrishnegowda Apr 24, 2025
0ed37a7
Update trivy.yml
rajithkrishnegowda Apr 24, 2025
2d37918
Update trivy.yml
rajithkrishnegowda Apr 24, 2025
19d040b
Create extract_emails.py
rajithkrishnegowda Apr 25, 2025
025d67d
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
2d99f1e
Update CODEOWNERS
rajithkrishnegowda Apr 25, 2025
522ad36
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
eaa2bcc
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
9601e1d
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
7ec5b90
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
447c942
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
68f986d
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
88e1769
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
10e0bf4
Create send_email.py
rajithkrishnegowda Apr 25, 2025
0796a83
Update trivy.yml
rajithkrishnegowda Apr 25, 2025
ee62c73
Merge branch 'securefederatedai:develop' into develop
rajithkrishnegowda Apr 30, 2025
7d8ebcc
Merge branch 'securefederatedai:develop' into develop
rajithkrishnegowda May 8, 2025
7c3f5eb
Create phi-4-quanti.ipynb
rajithkrishnegowda May 8, 2025
35667d0
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
633c27d
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
c7a9b42
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
4067c82
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
a3b71a5
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
0380c35
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
0335de7
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
7bb70cf
Update phi-4-quanti.ipynb
rajithkrishnegowda May 12, 2025
02f1942
Add files via upload
rajithkrishnegowda May 15, 2025
94916b2
Merge branch 'securefederatedai:develop' into develop
rajithkrishnegowda May 16, 2025
173c1e3
adding phi-4 with 4 bit quantization
May 16, 2025
1a9c1f4
removing unwanted files
May 16, 2025
5321986
reverting local changes
May 16, 2025
ce8dbb9
added 4bit and 8bit
May 16, 2025
f2a2eed
removed older code
May 16, 2025
46dba98
resolving comments
May 21, 2025
b684013
removed nvidia-smi cell
May 21, 2025
17f1bdf
fix code format
May 21, 2025
b1f48fc
renamed file name
May 21, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Loading
Loading