Ownership is measured by how many commits each author made to each file in the current tree. It highlights bus-factor risk (files only one person has ever touched) and where knowledge is concentrated. The bus factor is the smallest number of people who are, between them, primary owner of more than half of the files.
Files only one author has ever changed. The more a file has changed, the more knowledge is at risk if that person leaves.
| File | Sole owner | Commits |
|---|---|---|
| sql/core/src/test/resources/sql-tests/analyzer-results/st-functions.sql.out | Uros | 14 |
| sql/core/src/test/resources/sql-tests/inputs/st-functions.sql | Uros | 14 |
| sql/core/src/test/resources/sql-tests/results/st-functions.sql.out | Uros | 14 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/ArchiveReadSuiteBase.scala | akshatshenoi-db | 10 |
| python/pyspark/eval_handlers/tests/test_pandas_eval_type_handlers.py | Yicong Huang | 9 |
| python/pyspark/eval_handlers/__init__.py | Yicong Huang | 9 |
| resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorResizePlugin.scala | Dongjoon Hyun | 9 |
| resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorResizePluginSuite.scala | Dongjoon Hyun | 9 |
| python/pyspark/eval_handlers/_pandas.py | Yicong Huang | 8 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/MariaDBConnectionProvider.scala | Gabor Somogyi | 8 |
| File | Sole owner | Commits |
|---|---|---|
| sql/core/src/test/resources/sql-tests/analyzer-results/st-functions.sql.out | Uros | 14 |
| sql/core/src/test/resources/sql-tests/inputs/st-functions.sql | Uros | 14 |
| sql/core/src/test/resources/sql-tests/results/st-functions.sql.out | Uros | 14 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/ArchiveReadSuiteBase.scala | akshatshenoi-db | 10 |
| python/pyspark/eval_handlers/tests/test_pandas_eval_type_handlers.py | Yicong Huang | 9 |
| python/pyspark/eval_handlers/__init__.py | Yicong Huang | 9 |
| resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorResizePlugin.scala | Dongjoon Hyun | 9 |
| resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorResizePluginSuite.scala | Dongjoon Hyun | 9 |
| python/pyspark/eval_handlers/_pandas.py | Yicong Huang | 8 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/MariaDBConnectionProvider.scala | Gabor Somogyi | 8 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/PostgresConnectionProvider.scala | Gabor Somogyi | 8 |
| sql/catalyst/benchmarks/InternalRowComparableWrapperBenchmark-jdk21-results.txt | Dongjoon Hyun | 7 |
| sql/catalyst/benchmarks/InternalRowComparableWrapperBenchmark-results.txt | Dongjoon Hyun | 7 |
| core/src/test/scala/org/apache/spark/deploy/master/PersistenceEngineBenchmark.scala | Dongjoon Hyun | 7 |
| mllib/src/main/scala/org/apache/spark/ml/util/ConnectHelper.scala | Ruifeng Zheng | 7 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/pipeOperators.scala | Daniel Tenedorio | 7 |
| python/pyspark/eval_handlers/_base.py | Yicong Huang | 6 |
| python/pyspark/eval_handlers/tests/test_base_eval_type_handlers.py | Yicong Huang | 6 |
| python/pyspark/eval_handlers/tests/test_udtf_eval_type_handlers.py | Yicong Huang | 6 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/SupportsArchiveFormat.scala | akshatshenoi-db | 6 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/CSVArchiveReadBase.scala | akshatshenoi-db | 6 |
| sql/core/src/test/resources/sql-tests/inputs/binary.sql | Kent Yao | 6 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/DB2ConnectionProvider.scala | Gabor Somogyi | 6 |
| python/pyspark/eval_handlers/_udtf.py | Yicong Huang | 5 |
| python/pyspark/eval_handlers/verification.py | Yicong Huang | 5 |
| resource-managers/kubernetes/core/src/test/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPVCResizePluginSuite.scala | Dongjoon Hyun | 5 |
| sql/connect/client/jvm/src/test/scala/org/apache/spark/sql/connect/DataFrameSuite.scala | Ruifeng Zheng | 5 |
| mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/AFTBlockAggregator.scala | Ruifeng Zheng | 5 |
| mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/BinaryLogisticBlockAggregator.scala | Ruifeng Zheng | 5 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/BinByExec.scala | Nikolina Vraneš | 5 |
| sql/api/src/main/scala/org/apache/spark/sql/types/TimeType.scala | Max Gekk | 5 |
| sql/core/src/test/resources/sql-tests/inputs/charvarchar-standard-semantics.sql | Serge Rielau | 5 |
| sql/core/src/test/resources/sql-tests/results/charvarchar-standard-semantics.sql.out | Serge Rielau | 5 |
| docs/streaming/real-time-mode.md | Boyang Jerry Peng | 5 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/v2/state/StatePartitionAllColumnFamiliesReaderSuite.scala | Zifei Feng | 5 |
| python/conf_vscode/sitecustomize.py | Tian Gao | 5 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/command/v2/AutoCdcParserSuite.scala | Andreas Neumann | 5 |
| sql/api/src/main/scala/org/apache/spark/sql/types/GeometryType.scala | Uros | 5 |
| python/pyspark/eval_handlers/_elementwise.py | Yicong Huang | 4 |
| python/pyspark/eval_handlers/_stateful.py | Yicong Huang | 4 |
| python/pyspark/eval_handlers/utils.py | Yicong Huang | 4 |
| sql/catalyst/src/test/scala/org/apache/spark/sql/catalyst/xml/XmlInferSchemaTypeCastingSuite.scala | Wenchen Fan | 4 |
| resource-managers/kubernetes/core/src/main/scala/org/apache/spark/scheduler/cluster/k8s/ExecutorPVCResizePlugin.scala | Dongjoon Hyun | 4 |
| sql/core/benchmarks/RecursiveCTEBenchmark-jdk21-results.txt | Dongjoon Hyun | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/metric/CustomMetricsSuite.scala | Liang-Chi Hsieh | 4 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/internal/connector/SupportsRuntimeCatalystFiltering.scala | Szehon Ho | 4 |
| sql/catalyst/src/test/scala/org/apache/spark/sql/connector/catalog/InMemoryCatalystRuntimeFilterTable.scala | Szehon Ho | 4 |
| mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/HingeBlockAggregator.scala | Ruifeng Zheng | 4 |
| mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/HuberBlockAggregator.scala | Ruifeng Zheng | 4 |
| mllib/src/main/scala/org/apache/spark/ml/optim/aggregator/LeastSquaresBlockAggregator.scala | Ruifeng Zheng | 4 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/python/ExtractPythonUDFFromLambda.scala | Hyukjin Kwon | 4 |
| sql/core/src/main/java/org/apache/spark/sql/execution/datasources/parquet/LateMaterializationParquetRecordReader.java | Peter Toth | 4 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/parquet/ParquetStorageFilter.scala | Peter Toth | 4 |
| sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/expressions/DateTimeExpressionUtils.java | Gengliang Wang | 4 |
| sql/core/src/test/resources/sql-tests/inputs/try_aggregates.sql | Gengliang Wang | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/command/v1/AlterTableRenamePartitionSuite.scala | Max Gekk | 4 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/DaysWritable.scala | Max Gekk | 4 |
| sql/api/src/main/scala/org/apache/spark/sql/catalyst/parser/SubstituteParmsAstBuilder.scala | Serge Rielau | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/JsonArraySuite.scala | Ganesha S | 4 |
| sql/pipelines/src/main/scala/org/apache/spark/sql/pipelines/autocdc/Scd2VersionMap.scala | AnishMahto | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/benchmark/ConstantColumnVectorBenchmark.scala | YangJie | 4 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/resolver/ExpressionResolutionValidator.scala | Vladimir Golubev | 4 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/resolver/DelegatesResolutionToExtensions.scala | Vladimir Golubev | 4 |
| python/run-with-vscode-breakpoints | Tian Gao | 4 |
| udf/worker/core/src/main/scala/org/apache/spark/udf/worker/core/WorkerDispatcher.scala | Haiyang Sun | 4 |
| sql/catalyst/src/main/java/org/apache/spark/sql/catalyst/util/Geo.java | Uros | 4 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/expressions/st/STExpressionUtils.scala | Uros | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/BinaryFileArchiveReadBase.scala | akshatshenoi-db | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/TextArchiveReadBase.scala | akshatshenoi-db | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/XMLArchiveReadBase.scala | akshatshenoi-db | 4 |
| common/unsafe/src/main/java/org/apache/spark/unsafe/types/VariantVal.java | chenhao-db | 4 |
| sql/core/src/test/resources/sql-tests/analyzer-results/binary.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/analyzer-results/binary_base64.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/analyzer-results/binary_basic.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/analyzer-results/binary_hex.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/results/binary.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/results/binary_base64.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/results/binary_basic.sql.out | Kent Yao | 4 |
| sql/core/src/test/resources/sql-tests/results/binary_hex.sql.out | Kent Yao | 4 |
| core/src/main/resources/org/apache/spark/ui/static/flamegraph.js | Kent Yao | 4 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/catalog/UserDefinedFunctionErrors.scala | Allison Wang | 4 |
| sql/catalyst/src/main/java/org/apache/spark/sql/connector/expressions/aggregate/Avg.java | beliefer | 4 |
| python/docs/source/development/logger.rst | Haejoon Lee | 4 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/OracleConnectionProvider.scala | Gabor Somogyi | 4 |
| sql/core/src/test/scala/org/apache/spark/sql/execution/datasources/jdbc/connection/PostgresConnectionProviderSuite.scala | Gabor Somogyi | 4 |
| python/pyspark/eval_handlers/_typing.py | Yicong Huang | 3 |
| python/pyspark/eval_handlers/_vanilla.py | Yicong Huang | 3 |
| python/pyspark/eval_handlers/tests/test_elementwise_eval_type_handlers.py | Yicong Huang | 3 |
| python/pyspark/eval_handlers/tests/test_stateful_eval_type_handlers.py | Yicong Huang | 3 |
| python/pyspark/eval_handlers/tests/test_vanilla_eval_type_handlers.py | Yicong Huang | 3 |
| sql/core/src/main/scala/org/apache/spark/sql/execution/datasources/v2/AlterV2ViewExec.scala | Wenchen Fan | 3 |
| sql/core/benchmarks/DecimalDivideBenchmark-jdk21-results.txt | Dongjoon Hyun | 3 |
| sql/core/benchmarks/DecimalDivideBenchmark-jdk25-results.txt | Dongjoon Hyun | 3 |
| sql/core/benchmarks/DecimalDivideBenchmark-results.txt | Dongjoon Hyun | 3 |
| resource-managers/kubernetes/core/src/test/scala/org/apache/spark/deploy/k8s/KubernetesDriverSpecSuite.scala | Dongjoon Hyun | 3 |
| core/src/main/protobuf/buf.yaml | Dongjoon Hyun | 3 |
| sql/core/src/test/scala/org/apache/spark/sql/connector/CreateTableLikeSuite.scala | Liang-Chi Hsieh | 3 |
| sql/core/src/test/scala/org/apache/spark/sql/connector/GroupBasedRowLevelOperationCatalystRuntimeFilterSuite.scala | Szehon Ho | 3 |
| sql/core/src/test/scala/org/apache/spark/sql/connector/RowLevelOperationCatalystRuntimeFilterSuiteBase.scala | Szehon Ho | 3 |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/plans/logical/GeneratedColumnExpression.scala | Szehon Ho | 3 |
Primary owner = the author with the most commits to a file. Solely owned = files only that author has touched.
| Author | Files owned | Solely owned | Files touched |
|---|---|---|---|
| Michael Armbrust | 8,223 | 8,053 | 8,564 |
| Paddy Xu | 1,281 | 2 | 1,380 |
| Hyukjin Kwon | 1,236 | 805 | 4,846 |
| Yuchen Liu | 889 | 883 | 935 |
| Dylan Wong | 846 | 845 | 897 |
| Ruifeng Zheng | 814 | 164 | 2,676 |
| YangJie | 791 | 59 | 3,458 |
| Dongjoon Hyun | 747 | 84 | 2,977 |
| Wenchen Fan | 646 | 109 | 2,768 |
| Tian Gao | 511 | 19 | 1,427 |
| Yuming Wang | 474 | 68 | 1,388 |
| Max Gekk | 458 | 57 | 1,627 |
| Sean Owen | 375 | 73 | 2,038 |
| Kent Yao | 364 | 111 | 1,887 |
| Jungtaek Lim | 320 | 265 | 998 |
| panbingkun | 291 | 37 | 1,436 |
| Yi Wu | 289 | 5 | 1,065 |
| Serge Rielau | 287 | 72 | 985 |
| Daoyuan Wang | 270 | 265 | 381 |
| Cheng Hao | 269 | 269 | 411 |
| Herman van Hövell | 253 | 174 | 1,433 |
| Reynold Xin | 218 | 26 | 1,437 |
| Takeshi Yamamuro | 210 | 176 | 765 |
| Anish Shrigondekar | 201 | 172 | 356 |
| Xiangrui Meng | 187 | 8 | 632 |
Files touched by the most people — shared code where changes are most likely to need coordination.
| File | Contributors | Primary owner | Owner share |
|---|---|---|---|
| sql/catalyst/src/main/scala/org/apache/spark/sql/internal/SQLConf.scala | 270 | Wenchen Fan | 6.8% |
| pom.xml | 247 | Dongjoon Hyun | 21.0% |
| core/src/main/scala/org/apache/spark/SparkContext.scala | 205 | Reynold Xin | 6.3% |
| docs/configuration.md | 203 | Dongjoon Hyun | 6.3% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/Analyzer.scala | 196 | Wenchen Fan | 15.8% |
| project/SparkBuild.scala | 177 | YangJie | 9.2% |
| core/src/main/scala/org/apache/spark/util/Utils.scala | 175 | Dongjoon Hyun | 6.5% |
| common/utils/src/main/resources/error/error-conditions.json | 173 | Haejoon Lee | 6.4% |
| project/MimaExcludes.scala | 164 | Reynold Xin | 8.1% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/parser/AstBuilder.scala | 161 | Wenchen Fan | 8.5% |
| sql/core/src/test/scala/org/apache/spark/sql/SQLQuerySuite.scala | 145 | Reynold Xin | 7.4% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/optimizer/Optimizer.scala | 143 | Wenchen Fan | 9.3% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/catalyst/analysis/FunctionRegistry.scala | 142 | Max Gekk | 5.9% |
| python/pyspark/sql/dataframe.py | 141 | Hyukjin Kwon | 13.4% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryExecutionErrors.scala | 133 | Haejoon Lee | 11.3% |
| core/src/main/scala/org/apache/spark/internal/config/package.scala | 133 | Dongjoon Hyun | 13.9% |
| core/src/main/scala/org/apache/spark/scheduler/DAGScheduler.scala | 128 | Reynold Xin | 8.3% |
| docs/sql-programming-guide.md | 128 | Cheng Lian | 6.6% |
| sql/catalyst/src/main/scala/org/apache/spark/sql/errors/QueryCompilationErrors.scala | 122 | panbingkun | 9.0% |
| sql/core/src/main/scala/org/apache/spark/sql/execution/SparkStrategies.scala | 117 | Reynold Xin | 10.9% |
How Apache Spark compares with other Apache projects →
How Apache Spark ranks among Apache projects by AI-assisted commits →
Generate this report for your own repository with gitstats-action · All Gallery reports
Publishes the report to GitHub Pages on every push to main: turn on Pages for the gh-pages branch.
# .github/workflows/gitstats.yml
name: GitStats Report
on:
push:
branches: [main]
permissions:
contents: write
jobs:
gitstats:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v7
with:
fetch-depth: 0
- uses: shenxianpeng/gitstats-action@v1
with:
deploy-to-pages: true