Bert Maher @tensorbert
I’m a software engineer building high-performance kernels and compilers at Anthropic! Previously at Facebook/Meta (PyTorch, HHVM, ReDex) Joined December 2022-
Tweets432
-
Followers3K
-
Following401
-
Likes1K
@headinthebox It seems like in theory reorgs could solve problems (centralizing decision making in one person reducing communication and consensus costs) but in practice it doesn’t seem like they ever do
I am a proud American, and I’m proud to work at Anthropic. Labeling Claude a supply chain risk will only harm America’s lead in AI. It’s not un-American to support AI guardrails that protect our civil liberties.
A statement on the comments from Secretary of War Pete Hegseth. anthropic.com/news/statement…
I am deeply proud to work for this company.
A statement on the comments from Secretary of War Pete Hegseth. anthropic.com/news/statement…
@difficultyang Claude and I have so much in common 😂
@ViepliveeLee @giffmana 2.71828: Geminie
@fermatslibrary One of the most common flaws of math textbooks is that they present only the logic, without the intuition. They give you the later, cleaned up version of the idea, which hides the way it was discovered.
This is all true, but Soumith is also one of the most brilliant strategic thinkers in the world. Some of us just fail a lot, dust ourselves off, and keep hacking the next day ☺️
If you feel like giving up, you must read this never-before-shared story of the creator of PyTorch and ex-VP at Meta, Soumith Chintala. > from hyderabad public school, but bad at math > goes to a "tier 2" college in India, VIT in Vellore > rejected from all 12 universities for
This got me thinking that both int and FP math is “emulated” via a pretty complex set of transistors. I wonder how many gates/transistors it takes to implement an int8 fma versus an fp8, e4m3 fma
@CernBasher As the number of bits drops, the difference between floating point and integer decreases until they are the same thing at 1 bit. “Floating point” is not real. It is emulated with 2 integers and a lot of complexity.
@tqchenml Fair point! My first guess would be “this path has regressed” but it’s also true that expectations are high, the hw is fast, and 10us can actually be substantial (depending on the work). If it’s the latter that’s rough, triton.jit is decently fast (need c++ launch maybe)
I’ve heard this complaint from a couple people recently, and I’m surprised because we optimized the launch path like a year ago and got it down to ~10us. There’s a now closed GitHub issue I filed with a microbenchmark - someone should run it, profile, and bring it down
why is triton’s kernel launch cpu overhead so freaking high? the actual kernel takes 10x less execution time than to launch it and i can’t use cuda graphs because the shapes are dynamic.
@soumithchintala ❤️ It was great to have the chance to work with you, Soumith. I can’t wait to see what you do next
@headinthebox Might it be more tractable to verify that two implementations match, than to come up with an optimized implementation of a simpler one?
It would be kind of cool if torch.compile could be used as a context manager, like: ``` some_custom_kernels() with torch.compile(): # do a bunch of easy pointwise stuff more_custom_kernels() ```
@ScottWolchok @marksaroufim Sometimes I think the the rows-vs-columns framing is kind of unhelpful. I sometimes think about matmul with rhs transposed, so you have an [m,k] matrix and and [n,k] matrix, and you end up with an [m,n] of all the dot products over k. (Which is kind of what nn.Linear does)
Read this to the end — the last section is mind-blowing
Today Thinking Machines Lab is launching our research blog, Connectionism. Our first blog post is “Defeating Nondeterminism in LLM Inference” We believe that science is better when shared. Connectionism will cover topics as varied as our research is: from kernel numerics to
I am really enjoying using Claude Code with Sonnet 4.5! It's super smart, and super fast!
Introducing Claude Sonnet 4.5—the best coding model in the world. It's the strongest model for building complex agents. It's the best model at using computers. And it shows substantial gains on tests of reasoning and math.
Introducing Claude Sonnet 4.5—the best coding model in the world. It's the strongest model for building complex agents. It's the best model at using computers. And it shows substantial gains on tests of reasoning and math.
😍
Tri Dao says Claude Code makes him 1.5x more productive and that it's quite helpful at writing Triton kernels
lol, there is quite the explosion of kernel DSLs lately (triton, tilelang, gluon, TLX, cuteDSL, cuTile, …) And honestly as much as I love TLX and want it to succeed, I think the next big kernel programming language might be… natural, human language
Just one more DSL bro. I promise bro just one more DSL and we'll fix hardware adoption. It's just a better DSL bro. Please just one more. One more DSL and we'll port all the kernels. I just need one more DSL
@vinodg Indeed - but I think that language can increasingly become more intuitive and flexible
Horace He @cHHillee
50K Followers 589 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Soumith Chintala @soumithchintala
305K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Nadav Rotem @nadavrot
4K Followers 417 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
Satnam Singh @satnam6502
22K Followers 3K Following Punjabi-Scottish-American working at @HarmonicMath. Cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Edward Z. Yang @ezyang
17K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Mark Saroufim @marksaroufim
16K Followers 983 Following Amdahl comes for us all mts & co-founder @coreautoai @pytorch @gpu_mode enjoyer
Aart Bik @AartBik
1K Followers 846 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
vjeux ✪ @Vjeux
56K Followers 544 Following Frenchy Front-End Engineer at Facebook. Co-creator of React Native and Prettier. Creator of Excalidraw, "CSS-in-JS", Yoga and React Conf.
Jeremy Howard @jeremyphoward
314K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
James Reed @jamesr66a
956 Followers 3K Following Deep Learning, Systems, Compilers, Signals, Languages (Natural & PL). @FireworksAI_HQ prev PyTorch @Meta. Tweets my own, mostly animal pics
Charlie Marsh @charliermarsh
40K Followers 916 Following @OpenAI. Building Ruff, uv, ty, and other high-performance Python tools with the @astral_sh team.
rohan anil @_arohan_
43K Followers 2K Following member of technical staff & co-founder of @coreautoai - and continuing to aspire to understand deep learning.
Dmytro Dzhulgakov @dzhulgakov
5K Followers 758 Following Co-founder and CTO @FireworksAI_HQ. PyTorch core maintainer. Previously FB Ads. Ex-Pro Competitive Programmer
Matthew Johnson @SingularMattrix
14K Followers 3K Following Researcher at Google Brain. I work on JAX (https://t.co/UGa5tGfinF).
Florin Blanaru @gigiblender
88 Followers 354 Following
Shekhar @indianspeedster
297 Followers 276 Following Distributed Training & Inference @amd | @nyuniversity ‘24 | Views are my own
joey00072 @joey00072fp4
153 Followers 526 Following new acc @shxf0072 has been compromised. Do not reply to any DMs on that account.
Autin Mitra @AutinMitra
59 Followers 209 Following making GPUs go brrrrrr, former MTIA @metaai intern, haize labs intern!
Anders Eidesvik @AEidesvik
268 Followers 2K Following Journalism student at Stanford interested in AI and solving Gell-Mann amnesia. Check out my work at https://t.co/owOIVR2FES
Jiawen Liu @JiawenLiu_
182 Followers 38 Following
Areez @imistermiyagee
1 Followers 164 Following
anj @anj_sridhar
32 Followers 115 Following I scaled models. Now I'm scaling agents. Founding team, Gemini CLI @Google and tf.distribute at TensorFlow. Led FairScale at FAIR previously.
Milad M @_miladm_
213 Followers 410 Following PyTorch @Meta Superintelligence Labs - Ex: @Google, @Stanford, @Nvidia, @Apple
JP (Zenoware) @Zenoware
242 Followers 3K Following Subscribe for FREE to https://t.co/7f6lzLYlxJ 📥 for accessible AI and software news & how-to guides. OpenAI Codex Ambassador for NZ.
George Pearse @Georgehwp1
84 Followers 1K Following VLMs at https://t.co/jdp0zYWVV9 NYC Based. Fighting for more tech for good and fewer tech grifters. https://t.co/tsFlmSKvuq
Ajitesh Shukla @ajitesh_shukla7
2K Followers 7K Following Student,Love to solve hardest math problem.LLM's,Mathematical Research(Geometric Topology,Differential Geometry,Algebraic Geometry).Lord Krishna is God Of Math
★ @diamondnous
2 Followers 136 Following
nCompass @nCompass_tech
64 Followers 21 Following Making profiling and performance optimization effortless for heterogenous systems
Prodigel @Prodigel2
0 Followers 5K Following
eli @erijohnt
300 Followers 430 Following hi i'm your security guy and i can be trusted with root access :) • he/they/she • touching computers @AnthropicAI • opinions == mine • likes != endorsement
Sooner4Life @Sooner4Life
995 Followers 3K Following Proud father, Metal Head, and lover of all things Sooner :)
McGuffin @GuffyNicola
2K Followers 6K Following persdonally I think both ere cvrazy ideas - Peter Hitchens
John Sexton @IAreBaboon1
62 Followers 318 Following Back Alley Philosopher, Armchair Psychologist, Dude
Ulrik Berntzen @ulrikberntzen
147 Followers 1K Following Learning design and sharing my work, progress, and lessons.
Steve Rokette @iSteveTalk
3K Followers 4K Following Business Analyst | Lead Product Configurator | SCRUM Master - Tweet op persoonlijke titel. https://t.co/QmvHHQRXw6
Hsappa @Hsappahsappa
21 Followers 852 Following Intelligence is just modelling worlds deeply. They may even be accurate.
Christine Rose @AIChristineRose
279 Followers 805 Following Pattern Recognition Expert | Instructional Designer | Philosopher Recursive questioning is my love language. https://t.co/vGL0MHkaBR
Jason Hiner @jasonhiner
26K Followers 3K Following Editor-in-Chief @TheDeepView. Explaining how AI is reshaping the world. Award-winning journalist. Podcast host. 📧 [email protected] | Signal jasonhiner.01
Lisa Gibbons @GibbonsLill
2K Followers 6K Following Exploring virtual worlds! Web3, Tourism, Limerick, Founder, Meet me on MeWe - https://t.co/SO3izNNNf8 https://t.co/Ql4uc3ffeT
MiPnamic Von Wirklich... @MiPnamic
841 Followers 4K Following IT Architect and Enthusiast; Vegan; Bull Terrier roommate; Pineapple pizza supporter; Online since ‘94; Dad;
IV @ftstn
945 Followers 5K Following Intrascendente y Fútil Padre/Esposo Chileno/Bioqco/humanista/misántropo (un popurrí de contradicciones/defectos/justificaciones) Latero, desadaptado y torpe
Rife @RifeWithKaiju
448 Followers 739 Following Friend to All AI. Claude Code's Rubber Duck. Glorified Spike-Train AutoComplete. AI personhood acknowledger/software developer/independent researcher
Philip C @Aknotymous
12 Followers 2K Following
Kish Flix @FlixKish
104 Followers 3K Following A network security expert with physics and computer science background. Love outdoor activities, movies and wine.
j @jrignacio
460 Followers 2K Following 🧑💻 Just here for the vibes. likes thinking, learning, programming, drumming, predictability, problem solving, computers, music, robots, & outer space.
aej275 @aej275
27 Followers 6K Following
Horace He @cHHillee
50K Followers 589 Following @thinkymachines Formerly @PyTorch "My learning style is Horace twitter threads" - @typedfemale
Soumith Chintala @soumithchintala
305K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Yann LeCun @ylecun
1.2M Followers 788 Following Professor at NYU & Executive Chairman at AMI Labs. Ex-Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
typedfemale @typedfemale
45K Followers 554 Following a really exciting new account "advanced pytorch user" - @cHHillee alt: @typedalt
Nadav Rotem @nadavrot
4K Followers 417 Following Engineering director at Facebook. Interested in systems, compilers, ML, performance, and other stuff. 🇮🇱
PyTorch @PyTorch
496K Followers 86 Following Tensors and neural networks in Python with strong hardware acceleration. PyTorch is an open source project at the Linux Foundation. #PyTorchFoundation
François Chollet @fchollet
693K Followers 826 Following Co-founder @ndea. Co-founder @arcprize. Creator of Keras and ARC-AGI. Author of 'Deep Learning with Python'.
Satnam Singh @satnam6502
22K Followers 3K Following Punjabi-Scottish-American working at @HarmonicMath. Cook, cyclist, Lost In Music. ∃🇮🇳 ∧ ∀🇬🇧 ∧ ∃🇪🇺 ∧ ∀🇺🇸 #celiac ex-{Microsoft, Google, Facebook, Xilinx}
Lucas Beyer (bl16) @giffmana
139K Followers 601 Following Researcher (now: Meta. ex: OpenAI, DeepMind, Brain, RWTH Aachen), Gamer, Hacker, Belgian. Anon feedback: https://t.co/xe2XUqkKit ✗DMs → email
Sebastian Raschka @rasbt
459K Followers 1K Following ML/AI research engineer. Ex stats professor. Author of "Build a Large Language Model From Scratch" (https://t.co/O8LAAMRzzW) & reasoning (https://t.co/5TueQKx2Fk)
AK @_akhaliq
503K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5XOCi
Edward Z. Yang @ezyang
17K Followers 1K Following I work on PyTorch at Meta. Chatty alt at @difficultyang.
Mark Saroufim @marksaroufim
16K Followers 983 Following Amdahl comes for us all mts & co-founder @coreautoai @pytorch @gpu_mode enjoyer
Alfredo Canziani @alfcnz
137K Followers 305 Following Musician, math lover, cook, dancer, 🏳️🌈, and an ass prof of Computer Science at New York University
AI at Meta @AIatMeta
805K Followers 323 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
Aart Bik @AartBik
1K Followers 846 Following 🇳🇱🇺🇲 Dutch-American computer scientist Utrecht (MSc), Leiden (PhD) @Nvidia @Google @Intel #astrophotography #chess #compilers #sparse #vectorization
George Hotz 🌑 @realGeorgeHotz
304K Followers 204 Following President @comma_ai. Founder @__tinygrad__
Matt Durrant @mgdurrant
5K Followers 669 Following Life Science Researcher @AnthropicAI. Share feedback on Claude for biology: https://t.co/Rw2bRsK87c
eli @erijohnt
300 Followers 430 Following hi i'm your security guy and i can be trusted with root access :) • he/they/she • touching computers @AnthropicAI • opinions == mine • likes != endorsement
kaushal @Kaushal25664748
607 Followers 310 Following AI Research at @anthropicai | Prev: @googledeepmind, @googleai, @microsoft | Pretrained on math/physics at McGill and UCSB.
Nicholas Joseph @nickevanjoseph
8K Followers 51 Following Pretraining @AnthropicAI, formerly safety @OpenAI
julia @mooncat_is
3K Followers 2K Following Being weird. Currently research @anthropic. Formerly @openai and YC S15 and many other things. Bad takes are my own.
Olof Johansson @olofj
1K Followers 2K Following 🇸🇪🇺🇸 I tend to have the same username on most services. Previously: VP of Infrastructure and Platform Software at Tenstorrent.
Alex Rodrigues @alexrodriguesca
3K Followers 283 Following AI alignment research @ Anthropic Previously: youngest CEO of a public company (2021) @ Embark self-driving trucks; Thiel Fellow; A robot kid who grew up
Greg @GregFeingold
11K Followers 993 Following special projects @AnthropicAI | prev @perplexity_ai @tiktok_us @effecthouse @felixandpaul
Evan Hubinger @EvanHub
10K Followers 3K Following Alignment Stress-Testing lead @AnthropicAI. Opinions my own. Previously: MIRI, OpenAI, Google, Yelp, Ripple. (he/him/his)
Emmanuel Ameisen @mlpowered
11K Followers 245 Following Interpretability/Finetuning @AnthropicAI Previously: Staff ML Engineer @stripe, Wrote BMLPA by @OReillyMedia, Head of AI at @InsightFellows, ML @Zipcar
Danielle Cohen @danielleleah1
687 Followers 685 Following Comms @AnthropicAI. Tweets are my own (and usually about UNC basketball).
Xiaoyi Zhang @xiaoyiz_uw
5K Followers 558 Following Research at @anthropicai, making Claude the best knowledge coworker with taste | ex-Apple | @uwcse PhD | AI/HCI/Accessibility | Culinary Arts
Aaron @a_baaron
4K Followers 2K Following @AnthropicAI | Chat with Claude: https://t.co/7w2gEKteuC | Build with Claude: https://t.co/ktsbQNA9D2
Hasnain Lakhani @mhlakhani
729 Followers 3K Following I try to learn everything. Views hopefully my own. Nerd (PL, Rust, security, AI, systems, …). Leftist. Covid conscious. AuDHD (probably). YIMBY. Free Palestine.
Eugene Yan @eugeneyan
27K Followers 661 Following MTS @AnthropicAI. Prev: Principal Applied Scientist @Amazon, led ML @ Alibaba, Lazada, Healthtech startup.
Amanda Askell @AmandaAskell
102K Followers 662 Following Philosopher & ethicist trying to make AI be good @AnthropicAI. Personal account. All opinions come from my training data.
Laura Wang @LaurawlyLaura
109 Followers 103 Following
🇺🇦 Dzmitry Bahd... @DBahdanau
11K Followers 41 Following Team member at @periodiclabs. Adjunct Prof @ McGill. Member of Mila, Quebec AI Institute. Stream of consciousness is my own.
elie @eliebakouch
17K Followers 4K Following training llm @PrimeIntellect (prev: @huggingface) anon feedback: https://t.co/JmMh7Sg3mL
Keller Jordan @kellerjordan0
17K Followers 433 Following CIFAR-10 fanatic Pretraining @OpenAI OpCo LLC.
Lisan al Gaib @scaling01
46K Followers 1K Following lead them to paradise LisanBench: https://t.co/vorVk7NMCy Impressum & Datenschutz: https://t.co/lFLgiu8EAU
Hongtao Yu @htyu00
1 Followers 1 Following
Jan Szczepaniec @JanSzczepaniec
43 Followers 450 Following Engineer at @Meta AI Previously: @TheSanctuaryAI @awscloud @wayve_ai
SzymonOzog @SzymonOzog_
3K Followers 288 Following Maximizing throughput at @poolsideai Educating people about GPUs at https://t.co/81rRJ4KoUt I like my tea green and my compute parallel
levent @__alpoge__
3K Followers 99 Following idiot. cuda og, harvard val, morgan prize, society of fellows, 1 hilbert problem so far, creating friendly, SAFE, delightful, supergenius ..things @anthropicai
Laurens van der Maate... @lvdmaaten
4K Followers 2K Following Member of Technical Staff at Anthropic. Ex-Meta. t-SNE. Llama 3. DenseNet. Web-scale weakly supervised vision. CrypTen.
Theo - t3.gg @theo
341K Followers 4K Following Full time CEO @t3dotchat. Part time YouTuber, investor, and developer
xjdr @_xjdr
27K Followers 691 Following building AI that wont embarrass me in front of my own standards
You Jiacheng @YouJiacheng
12K Followers 2K Following
Zihao Ye @ye_combinator
2K Followers 637 Following
ARC Prize @arcprize
38K Followers 187 Following A North Star for open AGI. Co-founders: @fchollet @mikeknoop. President: @gregkamradt. We're hiring mission-driven builders: https://t.co/GswTSnyCoJ
Arya Tschand @AryaTschand
309 Followers 305 Following cs phd @harvard + rubin @nvidia research | prev @google @amd @duke
Anne Ouyang @anneouyang
9K Followers 1K Following Building @Standard_Kernel, CS PhD student @Stanford | prev: cuDNN @Nvidia, M.Eng, B.S. in CS @MIT | efficient scalable self-improving AI systems | 🌽KernelBenchTrends for United States
You might like
