r/dataengineering

General Information

As of February 8, 2024

Subreddit Name

r/dataengineering

Title

Data Engineering

Language

en

Public Description

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Description

News & discussion on Data Engineering topics, including but not limited to: data pipelines, databases, data formats, storage, data modeling, data governance, cleansing, NoSQL, distributed systems, streaming, batch, Big Data, and workflow engines.

Read our wiki: https://dataengineering.wiki/

Rules:...

Subscribers

159,275

Created

February 6, 2015

Type

public

Whitelist Status

all_ads

Flags

Restricted Submissions

Community Reviewed

Total Submissions

34,147

Total Comments

292,425

Earliest Submission

February 6, 2015

Earliest Comment

May 12, 2016

Metrics

Activity Over Time

totalSubmissions

totalComments

Submission Flags

gilded

over 18

locked

score hidden

text submission

stickied

distinguished user

saved

collapsed

quarantine

Comment Flags

gilded

locked

score hidden

distinguished user

collapsed

Submission Score Distribution

< 0

0

1-10

11-50

51-100

> 100

Comment Score Distribution

< 0

0

1-10

11-50

51-100

> 100

Title Length

0

1-100

101-500

501-1000

>1000

Submission Text Length

0

1-100

101-500

501-1000

>1000

Comments per Submission

< 0

0

1-10

11-50

51-100

> 100

Most Distinctive Words

Year

2024

Total Words in Subreddit

8,490,119

Total Words in Reddit

119,924,722,855

Rank↕	Word↕	Occurrences in Subreddit ↕	Total Occurrences ↕	Rate in Subreddit (per 1M words) ↕	Rate in Reddit (per 1M words) ↕	Ratio (Sub Rate / Reddit Rate) ↕
#1	databricks	8,592	34,070	1012.0	0.3	3562.19
#2	parquet	3,063	23,341	360.8	0.2	1853.63
#3	etl	5,810	60,020	684.3	0.5	1367.34
#4	redshift	2,265	24,878	266.8	0.2	1286.02
#5	dbt	10,388	139,953	1223.5	1.2	1048.44
#6	dlt	1,057	15,874	124.5	0.1	940.55
#7	orchestration	1,588	26,418	187.0	0.2	849.07
#8	postgres	3,056	57,970	359.9	0.5	744.64
#9	pipelines	5,304	104,603	624.7	0.9	716.23
#10	schemas	752	17,355	88.6	0.1	612.05
#11	kimball	863	20,011	101.6	0.2	609.17
#12	ingestion	1,602	41,720	188.7	0.3	542.39
#13	schema	3,494	106,700	411.5	0.9	462.54
#14	hadoop	1,077	33,935	126.9	0.3	448.29
#15	serverless	869	28,882	102.4	0.2	425.00
#16	snowflake	9,342	315,410	1100.3	2.6	418.37
#17	sql	18,497	651,547	2178.7	5.4	401.01
#18	powerbi	1,047	37,353	123.3	0.3	395.93
#19	warehousing	655	24,937	77.1	0.2	371.02
#20	partitioning	573	21,859	67.5	0.2	370.27
#21	elt	1,279	50,783	150.6	0.4	355.75
#22	apache	3,027	120,573	356.5	1.0	354.62
#23	adf	1,459	58,507	171.8	0.5	352.24
#24	dags	583	25,194	68.7	0.2	326.86
#25	dashboards	1,383	61,717	162.9	0.5	316.53
#26	pandas	2,889	132,005	340.3	1.1	309.14
#27	observability	371	17,310	43.7	0.1	302.74
#28	flink	728	35,092	85.7	0.3	293.03
#29	informatica	801	39,799	94.3	0.3	284.29
#30	bq	651	32,992	76.7	0.3	278.72
#31	airflow	6,370	337,854	750.3	2.8	266.32
#32	jupyter	340	18,543	40.0	0.2	259.00
#33	csv	2,374	132,180	279.6	1.1	253.69
#34	datasets	1,630	93,860	192.0	0.8	245.30
#35	querying	751	43,737	88.5	0.4	242.54
#36	synapse	1,313	78,828	154.7	0.7	235.28
#37	ec2	634	39,553	74.7	0.3	226.41
#38	scala	1,719	108,366	202.5	0.9	224.07
#39	pbi	357	23,538	42.0	0.2	214.24
#40	superset	318	21,705	37.5	0.2	206.95
#41	unstructured	442	30,649	52.1	0.3	203.70
#42	relational	863	61,132	101.6	0.5	199.41
#43	databases	2,616	185,344	308.1	1.5	199.37
#44	astronomer	356	25,461	41.9	0.2	197.50
#45	emr	516	37,343	60.8	0.3	195.18
#46	versioning	231	16,769	27.2	0.1	194.58
#47	iceberg	3,071	224,661	361.7	1.9	193.08
#48	transformations	1,978	150,791	233.0	1.3	185.29
#49	cron	484	37,117	57.0	0.3	184.19
#50	k8s	486	37,428	57.2	0.3	183.41

Showing 50 of 50 words