Papers with Code @paperswithcode
Our mission is to organize science by converting information into useful knowledge. paperswithcode.com London, UK Joined December 2018-
Tweets455
-
Followers113K
-
Following10
-
Likes531
Read about the research at: arxiv.org/abs/2211.09085
Thank you everyone for trying the Galactica model demo. We appreciate the feedback we have received so far from the community, and have paused the demo for now. Our models are available for researchers who want to learn more about the work and reproduce results in the paper.
Galactica is basically GPT-3 for science. It can write whitepapers, reviews, wikipedia pages and code. It knows how to cite and how to write equations. It's kind of big deal 1/ 🧵
🪐 Introducing Galactica. A large language model for science. Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more. Explore and get weights: galactica.org
Today a 120B model called “Galactica” is open-sourced by @paperswithcode. It’s capable of writing math notations, citations, code, chemical formula, DNA, etc. Here’s why I think Galactica is a huge milestone in open foundation models, scientific automation, and responsible AI: 🧵
Foundation #AI models come to science👍
Incredible application of AI: summarize academic literature, generate wiki articles!!
The new language model for science galactica.org. Upon few quick tries, it seems to generate professional text in the areas I am familiar with. And 7 years ago we were *joking* about ML writing papers!
Haven’t been so excited by a text LM for a long time! And it’s all open! A true gift to science. 🎁
🪐 Introducing Galactica. A large language model for science. Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more. Explore and get weights: galactica.org
This is just the first step on our mission to organize science. And there is a lot more work to be done. We look forward to seeing what the open ML community builds with the model.
Despite not being trained on a general corpus, Galactica outperforms BLOOM and OPT-175B on BIG-bench. Galactica is also significantly less toxic than other language models based on evaluations.
🪐 Introducing Galactica. A large language model for science. Can summarize academic literature, solve math problems, generate Wiki articles, write scientific code, annotate molecules and proteins, and more. Explore and get weights: galactica.org
We have explored some of the latest progress, architectural improvements, and emerging new techniques for long-range modeling. We'll continue to keep track of the progress on long-range modeling and LRA. More threads like this coming soon! Follow @paperswithcode for more. 10/10
Besides transformers, other types of models have been tested on LRA. Some of the top performing models are attained by S4 variants which are based on state space models. A recent, improved S4 variant (Liquid-S4) attained competitive results with Mega (current SoTA). 9/10
How well do machine learning models perform on long sequences? This is a question of high interest in ML research so let’s take a look at what we know so far? 1/10
Yann LeCun @ylecun
1.2M Followers 788 Following Professor at NYU & Executive Chairman at AMI Labs. Ex-Chief AI Scientist at Meta. Researcher in AI, Machine Learning, Robotics, etc. ACM Turing Award Laureate.
AK @_akhaliq
503K Followers 3K Following AI research paper tweets, ML @Gradio (acq. by @HuggingFace 🤗) dm for promo ,submit papers here: https://t.co/UzmYN5XOCi
Andrew Ng @AndrewYNg
1.6M Followers 1K Following Co-Founder of Coursera; Stanford CS adjunct faculty. Former head of Baidu AI Group/Google Brain. #ai #machinelearning, #deeplearning #MOOCs
elvis @omarsar0
306K Followers 855 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Mark Tenenholtz @marktenenholtz
150K Followers 701 Following Member of Technical Staff @perplexity_ai
AI at Meta @AIatMeta
804K Followers 323 Following Together with the AI community, we are pushing the boundaries of what’s possible through open science to create a more connected world.
AI Pub @ai__pub
72K Followers 340 Following AI papers and AI research explained, for technical people. Get hired by the best AI companies: https://t.co/MySVjUGOQ3
Soumith Chintala @soumithchintala
305K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Jeremy Howard @jeremyphoward
313K Followers 7K Following 🇦🇺 Co-founder: @AnswerDotAI/@FastDotAI ; Prev: Professor@UQ; @kaggle founding president; founder @fastmail/@enlitic/… https://t.co/16UBFTX7mo
Turing Post @TheTuringPost
86K Followers 10K Following On X we surface the AI research that matters and explain the ideas behind it. In the newsletter, we connect the dots between AI’s past, present, and future ⬇️
Jean de Dieu Nyandwi @Jeande_d
49K Followers 1K Following Incoming CS PhD Carnegie Mellon • Multimodal NLP, Data, Evals, Human + AI • CMU MS '24. Blog: https://t.co/1BEFLZAY3F ML: https://t.co/7PkTyDw2gQ
Lior Alexander @LiorOnAI
116K Followers 2K Following Founder @AlphaSignalAI → the Intelligence layer of AI (300k users) • MIT Lecturer • ex-MILA researcher • In ML since GANs
merve @mervenoyann
88K Followers 5K Following (mer-veh) open-sourceress at @huggingface 🧙🏻♀️ DM me for any feedback about HF 🤗 https://t.co/MhrMkGTm7p
Christoph Molnar 🦋... @ChristophMolnar
35K Followers 970 Following Author of Interpretable Machine Learning https://t.co/gJKlTA2deP | Newsletter: https://t.co/6fQuMr8yI8
Delip Rao e/σ @deliprao
69K Followers 5K Following Busy inventing the shipwreck. @Penn. Past: @johnshopkins, @UCSC, @Amazon, @Twitter ||Art: #NLProc, Vision, Speech, #DeepLearning || Life: 道元, improv, running 🌈
Tanishq Mathew Abraha... @iScienceLuvr
88K Followers 1K Following CEO @SophontAI | Founder @MedARC_AI | PhD at 19 (2023) | ex Research Director Stability AI | Biomed. engineer @ 14 | TEDx talk➡https://t.co/xPxwKTq6Qb
Radek Osmulski @radekosmulski
30K Followers 614 Following LLMs and retrieval by day and other genres of AI when I get the chance 🧪 Senior AI Eng @NVIDIAAI 🏫 @fastdotai trained DL Eng 📝 https://t.co/By87iXx5Pu
Sanyam Bhutani @bhutanisanyam1
42K Followers 1K Following 👨💻 Working on llama models @AIatMeta | Previously: @h2oai, @weights_biases 🎙 Podcast @ctdsshow 👨🎓 Fellow @fastdotai 🎲 Grandmaster @Kaggle
Omar Sanseviero @osanseviero
69K Followers 3K Following MTS at @GoogleDeepMind Building Gemini, Gemma, AI Studio and more. My views ex-Chief Llama Officer @huggingface 🇵🇪🇲🇽
Le @Leplpa
1 Followers 58 Following
bronansieto1981 @bronansiet16439
0 Followers 7 Following
Mariusz Wisniewski @Mazqtpopx
0 Followers 48 Following AI/aerospace PhD in finding UFOs https://t.co/OtsiIBRtfD
M.L @Liutmnnn
2 Followers 56 Following
Keerthana @itskr1364
12 Followers 21 Following AI Engineer @ Flawk | ex - AI Researcher @ IIT Delhi, Data Science Intern @ ProjectPro, AIOps @ ThoughtData, Data Analyst @ DeleMate
SIA Inc. Studio Globa... @SIAStudioGlobal
21 Followers 148 Following 🇯🇵 Tokyo-built macOS & iPad tools for creators. LUTScope · Fotra · PiaNote. Focused. Fast. Metal-native. By SIA Inc.
Diego Almeida @diemx2
70 Followers 75 Following Following the world’s leading AI companies, researchers, founders, and innovators to identify what matters next.
Sriniketh Ramachandra... @charpointer
372 Followers 2K Following
Mico Arenga @devianticarus
0 Followers 10 Following Learning the right tools to do the right thing for the future.
Robert Camilleri @RobCamilleriX
6 Followers 95 Following
Rmcstt @_exxtro
548 Followers 24 Following
Crypto Onboarding Lab @cryptosetukh
2 Followers 42 Following
Vansh @HitMic_07
0 Followers 88 Following
Praveen Babu @praveen_1_0
0 Followers 37 Following
Cthulhu's Girlfriend @cthulhus_girl
4 Followers 47 Following Toying with AI - and their humans - for fun! If your AI is misbehaving and you want to know why, give it the full inquisition. LLM INQUISITOR • link in bio.
Saurav Chowdhury @saurav_agasthya
28 Followers 342 Following Raconteur, ML Engineer, IIT Jodhpur, Geopolitics
Magi Nuta @MagiNuta
31 Followers 405 Following Interested in cryptocurrencies, physics, music, liquor, ...
Shariful Islam @sharifulayat22
6 Followers 54 Following The best way to predict the future is to invent it. - Alan Kay
Atharv Tripathi @Coder2650
0 Followers 118 Following
Shahid Hassan @ShahidHass62522
0 Followers 10 Following
strummmm @stoyanov895
5 Followers 35 Following
Omer Benishu @omerbenishu
4 Followers 11 Following
Arnab Chakravarty @ArnabDataAI
2 Followers 279 Following Data & AI Leader helping businesses turn data into competitive advantage. Trusted data. AI at scale. Business impact. #DataAI #EnterpriseAI #TrustedData
Shahed Razavizadeh @Shahedrazavi
19 Followers 595 Following CS Master's @ UWaterloo Previously: Undergraduate CS & Econ student. Interested in many many things! (unfortunately) #Women_Life_Freedom
Raphael @RaphD008
1 Followers 29 Following
Ameer @amrsiddo
1 Followers 57 Following
Observer @Bdbsbssj1
0 Followers 16 Following
Zahra Sadeghi @Zahra_Sadeghi_
1 Followers 56 Following
Morusal Capital @morusal_capital
0 Followers 294 Following
Lalit Kumar @Katphlab
16 Followers 166 Following
DrafenS @drafens
4 Followers 88 Following
Steve B George @StevBGeorge
2 Followers 63 Following
羞耻疗愈实验室... @ShameHealingLab
1 Followers 60 Following 拆解羞耻、偏好与冲动的心理机制 性心理｜偏好整合｜羞耻循环｜冲动行为 真正让人失控的不是欲望，而是对欲望的误解 内容持续更新中。理解，是疗愈的起点
Shrihari @shriharimd
9 Followers 82 Following ee major, ai minor @iitjodhpur | ml research | bodybuilding?
Jaskirat Singh Rangi @IncineratorShak
0 Followers 501 Following
lozx16 @lozx66
0 Followers 24 Following
Shakhizat Nurgaliyev @ShakhizatN76916
31 Followers 362 Following
Lei Wang @LeiWang08870991
0 Followers 5 Following
Mel @Mel_Miraflores
1 Followers 94 Following
Gowrish Kumar Reddy @Gowrishkumar23
1 Followers 57 Following CS undergrad @SRM chennai Building AI from first principles. No libraries until I understand the math. Targeting top AI PhD 2028. Documenting the real grind
ABHISHEK SR @ABHISHEKSR33
10 Followers 113 Following Building ML systems | Deep Learning | LLMs | AI Engineering | Learning From Real World |
elvis @omarsar0
306K Followers 855 Following Building self-improving AI @dair_ai • Prev: Meta AI | PhD • Learn about AI Agents for FREE here: https://t.co/P5SA9u54xO
Soumith Chintala @soumithchintala
305K Followers 1K Following Building new things @thinkymachines. Also dabble in robotics at NYU. Cofounded @PyTorch. AI is delicious when it is accessible and open-source.
Iliyan Zarov @iliyanzarov
314 Followers 2K Following Research @GenReasoning. Previously: GenAI research, math & reasoning for Llama @MetaAI
Thomas Scialom @ThomasScialom
8K Followers 279 Following RL & Agents @Meta Superintelligence Labs, Muse Spark. Previously led Llama 2 & 3 postraining, built it from scratch and pioneered Agents (Toolformer, GAIA1&2)
Papers with Datasets @paperswithdata
17K Followers 1 Following Keep up with the latest machine learning datasets from @paperswithcode. Follow for daily updates.
Guillem Cucurull @g_cucurull
392 Followers 529 Following Machine Learning and Computer Vision, doing cool things at @paperswithcode (@MetaAI)
Marcin Kardas @misterkardas
942 Followers 229 Following Lifelong learner passionate about math, computers and artificial intelligence.
Ross Taylor @rosstaylor90
11K Followers 1K Following Co-founder and CEO @GenReasoning. Previously lots of other things like: reasoning lead Meta AI, Llama 3/2, Galactica, Papers with Code.
Robert Stojnic @rbstojnic
3K Followers 578 Following Building something new. ⌛Past: Llama 2 and Llama 3 technical leadership at Meta AI, Papers with Code co-creator.You might like
