r/mlscaling
Scaling Machine Learning: Big Models/Data/Compute—More Is More
en
ML/AI/DL research on approaches using large models, datasets, and compute: "more is different"
Subreddit for discussing AI, machine learning, or deep learning approaches involving big numbers: billions of parameters, millions of n, petaflops, etc. eg GPT-3. Most research is conducted at ...
7,283
October 30, 2020
public
all_ads
Total Submissions
1,956
Total Comments
6,038
Earliest Submission
October 30, 2020
Earliest Comment
October 30, 2020
Rank↕ | Word↕ | Occurrences in Subreddit | Total Occurrences | Rate in Subreddit (per 1M words) | Rate in Reddit (per 1M words) | Ratio (Sub Rate / Reddit Rate) |
|---|---|---|---|---|---|---|
| #1 | 329 | 50,279 | 1108.1 | 0.4 | 2643.11 | |
| #2 | 107 | 19,812 | 360.4 | 0.2 | 2181.53 | |
| #3 | 65 | 18,106 | 218.9 | 0.2 | 1450.10 | |
| #4 | 165 | 51,193 | 555.8 | 0.4 | 1301.90 | |
| #5 | 61 | 22,907 | 205.5 | 0.2 | 1075.64 | |
| #6 | 85 | 37,286 | 286.3 | 0.3 | 920.83 | |
| #7 | 62 | 27,234 | 208.8 | 0.2 | 919.57 | |
| #8 | 41 | 22,052 | 138.1 | 0.2 | 751.00 | |
| #9 | 97 | 52,741 | 326.7 | 0.4 | 742.90 | |
| #10 | 260 | 142,179 | 875.7 | 1.2 | 738.66 | |
| #11 | 442 | 248,687 | 1488.7 | 2.1 | 717.92 | |
| #12 | 53 | 31,086 | 178.5 | 0.3 | 688.68 | |
| #13 | 139 | 87,098 | 468.2 | 0.7 | 644.63 | |
| #14 | 38 | 23,929 | 128.0 | 0.2 | 641.45 | |
| #15 | 57 | 38,977 | 192.0 | 0.3 | 590.71 | |
| #16 | 95 | 70,396 | 320.0 | 0.6 | 545.11 | |
| #17 | 356 | 279,369 | 1199.1 | 2.3 | 514.73 | |
| #18 | 48 | 41,742 | 161.7 | 0.3 | 464.49 | |
| #19 | 104 | 93,860 | 350.3 | 0.8 | 447.57 | |
| #20 | 67 | 60,916 | 225.7 | 0.5 | 444.27 | |
| #21 | 113 | 105,722 | 380.6 | 0.9 | 431.74 | |
| #22 | 45 | 42,510 | 151.6 | 0.4 | 427.59 | |
| #23 | 170 | 169,618 | 572.6 | 1.4 | 404.84 | |
| #24 | 54 | 53,901 | 181.9 | 0.4 | 404.67 | |
| #25 | 59 | 59,638 | 198.7 | 0.5 | 399.61 | |
| #26 | 259 | 281,284 | 872.4 | 2.3 | 371.93 | |
| #27 | 49 | 56,460 | 165.0 | 0.5 | 350.56 | |
| #28 | 156 | 180,525 | 525.4 | 1.5 | 349.05 | |
| #29 | 199 | 238,209 | 670.3 | 2.0 | 337.44 | |
| #30 | 43 | 53,268 | 144.8 | 0.4 | 326.07 | |
| #31 | 41 | 54,240 | 138.1 | 0.5 | 305.33 | |
| #32 | 49 | 65,197 | 165.0 | 0.5 | 303.58 | |
| #33 | 347 | 474,410 | 1168.8 | 4.0 | 295.45 | |
| #34 | 124 | 172,164 | 417.7 | 1.4 | 290.93 | |
| #35 | 41 | 61,742 | 138.1 | 0.5 | 268.23 | |
| #36 | 44 | 68,436 | 148.2 | 0.6 | 259.70 | |
| #37 | 362 | 593,940 | 1219.3 | 5.0 | 246.19 | |
| #38 | 571 | 948,452 | 1923.2 | 7.9 | 243.18 | |
| #39 | 209 | 378,969 | 704.0 | 3.2 | 222.77 | |
| #40 | 35 | 64,483 | 117.9 | 0.5 | 219.24 | |
| #41 | 184 | 339,053 | 619.7 | 2.8 | 219.21 | |
| #42 | 610 | 1,174,454 | 2054.6 | 9.8 | 209.80 | |
| #43 | 132 | 262,164 | 444.6 | 2.2 | 203.38 | |
| #44 | 148 | 309,671 | 498.5 | 2.6 | 193.05 | |
| #45 | 39 | 85,043 | 131.4 | 0.7 | 185.24 | |
| #46 | 36 | 78,906 | 121.3 | 0.7 | 184.29 | |
| #47 | 74 | 174,358 | 249.2 | 1.5 | 171.43 | |
| #48 | 143 | 342,137 | 481.7 | 2.9 | 168.83 | |
| #49 | 30 | 79,446 | 101.0 | 0.7 | 152.53 | |
| #50 | 46 | 121,862 | 154.9 | 1.0 | 152.47 |