Skip to content
Navigation Menu
Sign in
Appearance settings
Platform
AI CODE CREATION
GitHub Copilot
Write better code with AI
GitHub Copilot app
Direct agents from issue to merge
MCP Registry
Integrate external tools
DEVELOPER WORKFLOWS
Actions
Automate any workflow
Codespaces
Instant dev environments
Issues
Plan and track work
Code Review
Manage code changes
Code Quality
Enforce quality at merge
APPLICATION SECURITY
GitHub Advanced Security
Find and fix vulnerabilities
Code security
Secure your code as you build
Secret protection
Stop leaks before they start
EXPLORE
Why GitHub
Documentation
Blog
Changelog
Marketplace
View all features
Solutions
BY COMPANY SIZE
Enterprises
Small and medium teams
Startups
Nonprofits
BY USE CASE
App Modernization
DevSecOps
DevOps
CI/CD
View all use cases
BY INDUSTRY
Healthcare
Financial services
Manufacturing
Government
View all industries
View all solutions
Resources
EXPLORE BY TOPIC
AI
Software Development
DevOps
Security
View all topics
EXPLORE BY TYPE
Customer stories
Events & webinars
Ebooks & reports
Business insights
GitHub Skills
SUPPORT & SERVICES
Documentation
Customer support
Community forum
Trust center
Partners
View all resources
Open Source
COMMUNITY
GitHub Sponsors
Fund open source developers
PROGRAMS
Security Lab
Maintainer Community
Accelerator
GitHub Stars
Archive Program
REPOSITORIES
Topics
Trending
Collections
Enterprise
ENTERPRISE SOLUTIONS
Enterprise platform
AI-powered developer platform
AVAILABLE ADD-ONS
GitHub Advanced Security
Enterprise-grade security features
Copilot for Business
Enterprise-grade AI features
Premium Support
Enterprise-grade 24/7 support
Pricing
Type
/
to search
Sign in
Sign up
Appearance settings
You signed in with another tab or window.
Reload
to refresh your session.
You signed out in another tab or window.
Reload
to refresh your session.
You switched accounts on another tab or window.
Reload
to refresh your session.
Dismiss alert
{{ message }}
Uh oh!
There was an error while loading.
Please reload this page
.
hyperifyio
/
gnd
Public
Notifications
You must be signed in to change notification settings
Fork
0
Star
0
Code
Issues
89
Pull requests
8
Actions
Projects
Security and quality
0
Insights
Additional navigation options
Code
Issues
Pull requests
Actions
Projects
Security and quality
Insights
Bitnet
- #205
#205
Draft
thejhh
wants to merge 21 commits into
main
hyperifyio/gnd:main
from
bitnet
hyperifyio/gnd:bitnet
Copy head branch name to clipboard
Conversation
Commits
21
(21)
Checks
Files changed
Draft
Bitnet
#205
thejhh
wants to merge 21 commits into
main
hyperifyio/gnd:main
from
bitnet
hyperifyio/gnd:bitnet
Copy head branch name to clipboard
Commits
Commits on May 19, 2025
feat(bitnet): Initial project setup for BitNet implementation (#193)
Show description for 3376b6c
thejhh
and
Jaakko Heusala
authored
3376b6c
View commit details
Copy full SHA for 3376b6c
Browse repository at this point
chore: update gitignore for generated files and profiles (#195)
Show description for 770d24e
thejhh
and
Jaakko Heusala
authored
770d24e
View commit details
Copy full SHA for 770d24e
Browse repository at this point
Commits on May 20, 2025
feat(bitnet/model): implement model weights and tokenizer integration (#197)
Show description for 7cd6cf2
3 people
authored
7cd6cf2
View commit details
Copy full SHA for 7cd6cf2
Browse repository at this point
feat(bitnet): implement core model structures and weight loading (#198)
Show description for 873db9e
thejhh
and
Jaakko Heusala
authored
873db9e
View commit details
Copy full SHA for 873db9e
Browse repository at this point
Commits on May 21, 2025
174 implement tokenizer llama3 bpe (#199)
Show description for 92ed458
thejhh
and
Jaakko Heusala
authored
92ed458
View commit details
Copy full SHA for 92ed458
Browse repository at this point
200 improve pr messages (#201)
Show description for 918afa5
thejhh
and
Jaakko Heusala
authored
918afa5
View commit details
Copy full SHA for 918afa5
Browse repository at this point
feat(bitnet): implement token embedding layer (#202)
Show description for 73d46ca
thejhh
and
Jaakko Heusala
authored
73d46ca
View commit details
Copy full SHA for 73d46ca
Browse repository at this point
176 set model constants architecture hyperparameters (#203)
Show description for d903685
thejhh
and
Jaakko Heusala
authored
d903685
View commit details
Copy full SHA for d903685
Browse repository at this point
177 implement rotary positional encoding (#204)
Show description for 854a392
thejhh
and
Jaakko Heusala
authored
854a392
View commit details
Copy full SHA for 854a392
Browse repository at this point
feat(tensor): add BitLinear layer and tests (#178) (#206)
Show description for 8ee212a
thejhh
and
Jaakko Heusala
authored
8ee212a
View commit details
Copy full SHA for 8ee212a
Browse repository at this point
feat(bitnet): implement Sub-Layer Normalization (SubLN) for #179 (#207)
Show description for 5c226f2
thejhh
and
Jaakko Heusala
authored
5c226f2
View commit details
Copy full SHA for 5c226f2
Browse repository at this point
feat(bitnet): implement squared ReLU activation (ReLU²) (#208)
Show description for 6701f78
thejhh
and
Jaakko Heusala
authored
6701f78
View commit details
Copy full SHA for 6701f78
Browse repository at this point
Commits on May 22, 2025
feat(bitnet): implement QKV projection for attention (#209)
Show description for 59ffb58
thejhh
and
Jaakko Heusala
authored
59ffb58
View commit details
Copy full SHA for 59ffb58
Browse repository at this point
feat(bitnet): implement scaled dot-product attention (#210)
Show description for 44af36b
thejhh
and
Jaakko Heusala
authored
44af36b
View commit details
Copy full SHA for 44af36b
Browse repository at this point
Optimize attention weights multiplication with values (#211)
Show description for e854776
thejhh
and
Jaakko Heusala
authored
e854776
View commit details
Copy full SHA for e854776
Browse repository at this point
feat(math): add attention output projection layer (#184) (#212)
Show description for 79383e0
thejhh
and
Jaakko Heusala
authored
79383e0
View commit details
Copy full SHA for 79383e0
Browse repository at this point
feat(math): add FFN sublayer for transformer block (#213)
Show description for ba16dd3
thejhh
and
Jaakko Heusala
authored
ba16dd3
View commit details
Copy full SHA for ba16dd3
Browse repository at this point
186 integrate attention sublayer pre norm residual (#214)
Show description for 61b4722
thejhh
and
Jaakko Heusala
authored
61b4722
View commit details
Copy full SHA for 61b4722
Browse repository at this point
feat(bitnet): implement feed-forward sublayer with pre-norm and residual connections (#215)
Show description for 31249ce
thejhh
and
Jaakko Heusala
authored
31249ce
View commit details
Copy full SHA for 31249ce
Browse repository at this point
Commits on May 23, 2025
188 stack transformer blocks (#216)
Show description for 9ba4b49
thejhh
and
Jaakko Heusala
authored
9ba4b49
View commit details
Copy full SHA for 9ba4b49
Browse repository at this point
feat(math): implement LM head with error handling (#217)
Show description for 6169dc4
thejhh
and
Jaakko Heusala
authored
6169dc4
View commit details
Copy full SHA for 6169dc4
Browse repository at this point
You can’t perform that action at this time.
