clean data with spark in python and SQL

MadeiraData · Oct 16, 2024 · 7126a37 · 7126a37
1 parent 6268758
commit 7126a37
Show file tree

Hide file tree

Showing 3 changed files with 12 additions and 0 deletions.
diff --git a/Databricks/clean data with spark/clean data with spark SQL.dbc b/Databricks/clean data with spark/clean data with spark SQL.dbc
diff --git a/Databricks/clean data with spark/clean data with spark python.dbc b/Databricks/clean data with spark/clean data with spark python.dbc
diff --git a/Databricks/clean data with spark/orders_raw.csv b/Databricks/clean data with spark/orders_raw.csv
@@ -0,0 +1,12 @@
+order_id,order_date,customer_id,amount
+1,27/09/2024,101,10
+2,,101,11
+3,29/09/2024,201,12
+4,30/09/2024,101,13
+4,30/09/2024,101,13
+5,01/10/2024,301,
+6,02/10/2024,401,15
+7,03/10/2024,,16
+8,32/10/2024,501,17
+9,05/10/2024,301,AAA
+10,06/10/2024,401,19