GitHub - BhukyaKishore/pyspark-notes: PySpark is the Python API for Apache Spark, a powerful open-source framework designed for large-scale data processing and analytics. It allows developers and data engineers to write Spark applications using Python while leveraging Spark’s distributed computing engine.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 1 Commit
00_index.md		00_index.md
01_introduction_to_big_data.md		01_introduction_to_big_data.md
02_distributed_computing_concepts.md		02_distributed_computing_concepts.md
03_pyspark_architecture.md		03_pyspark_architecture.md
04_environment_setup.md		04_environment_setup.md
05_rdd_fundamentals.md		05_rdd_fundamentals.md
06_dataframe_basics.md		06_dataframe_basics.md
07_dataframe_advanced.md		07_dataframe_advanced.md
08_spark_sql.md		08_spark_sql.md
09_data_sources_formats.md		09_data_sources_formats.md
10_transformations_vs_actions.md		10_transformations_vs_actions.md
11_partitioning_optimization.md		11_partitioning_optimization.md
12_joins_aggregations.md		12_joins_aggregations.md
13_window_functions.md		13_window_functions.md
14_udfs_custom_functions.md		14_udfs_custom_functions.md
15_performance_tuning.md		15_performance_tuning.md
16_caching_persistence.md		16_caching_persistence.md
17_error_handling_debugging.md		17_error_handling_debugging.md
18_spark_streaming.md		18_spark_streaming.md
19_machine_learning.md		19_machine_learning.md
20_real_world_projects.md		20_real_world_projects.md
img.png		img.png

About

PySpark is the Python API for Apache Spark, a powerful open-source framework designed for large-scale data processing and analytics. It allows developers and data engineers to write Spark applications using Python while leveraging Spark’s distributed computing engine.