Skip to content

Commit 7d5fb6b

Browse files
committed
Add reproducibility artifacts to remaining statistical skills
1 parent b076cd4 commit 7d5fb6b

11 files changed

Lines changed: 22 additions & 0 deletions

File tree

skills/stat-assess-data-quality/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,12 +32,14 @@ description: Assess data quality by reporting missing values, outliers, sample s
3232
6. Produce a missingness heatmap (rows = samples, columns = variables) if any missing values exist.
3333
7. Write a quality report (TSV) and missingness plot (PDF) to output directory.
3434
8. Summarize flags: list columns requiring attention and recommended actions (imputation, removal, transformation).
35+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3536

3637
## Output Contract
3738

3839
- Quality report table (TSV): column, dtype, n_non_missing, n_missing, missing_rate, n_outliers, outlier_rate, mean, sd, min, max, flags
3940
- Missingness heatmap (PDF, only if missing values present)
4041
- Summary of flagged columns (printed to stdout)
42+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4143

4244
## Limits
4345

skills/stat-bayesian-estimation/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -37,6 +37,7 @@ description: Estimate model parameters using Bayesian inference (MCMC via Stan o
3737
8. Generate posterior predictive check plot (observed vs. simulated data).
3838
9. Write posterior summary (TSV), trace plots (PDF), and posterior plots (PDF) to output directory.
3939
10. Report convergence diagnostics; flag any parameters with R-hat ≥ 1.01 or ESS < 400.
40+
11. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
4041

4142
## Output Contract
4243

@@ -45,6 +46,7 @@ description: Estimate model parameters using Bayesian inference (MCMC via Stan o
4546
- Posterior distribution plots (PDF)
4647
- Posterior predictive check plot (PDF)
4748
- Convergence warnings (printed to stdout if any)
49+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4850

4951
## Limits
5052

skills/stat-cluster-samples/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -40,6 +40,7 @@ description: Cluster samples or features using k-means or hierarchical clusterin
4040
4. Compute silhouette score for final cluster solution; report mean and per-sample scores.
4141
5. Assign and report cluster labels for each sample.
4242
6. Write cluster assignments (TSV), silhouette scores (TSV), heatmap or cluster plot (PDF) to output directory.
43+
7. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
4344

4445
## Output Contract
4546

@@ -48,6 +49,7 @@ description: Cluster samples or features using k-means or hierarchical clusterin
4849
- Clustered heatmap (PDF, hierarchical) or cluster scatter plot (PDF, k-means)
4950
- Elbow curve (PDF, k-means only when k is auto-selected)
5051
- Mean silhouette score (printed to stdout)
52+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
5153

5254
## Limits
5355

skills/stat-compare-two-groups/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,12 +35,14 @@ description: Compare a continuous variable between two groups with automatic sel
3535
7. Generate a box plot with individual data points and significance annotation.
3636
8. Write a structured result and plot (PDF) to output directory.
3737
9. Report method used, test statistic, p-value, effect size, confidence interval, and interpretation.
38+
10. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3839

3940
## Output Contract
4041

4142
- Result (TSV): group1, group2, method_used, statistic, p_value, effect_size, effect_size_type, ci_lower, ci_upper, n_group1, n_group2
4243
- Box plot with data points (PDF)
4344
- Decision log explaining method selection (printed to stdout)
45+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4446

4547
## Limits
4648

skills/stat-fit-glm/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,13 +35,15 @@ description: Fit a generalized linear model (Poisson, Binomial, or Gaussian fami
3535
6. Generate diagnostic plots: residuals vs. fitted (Pearson residuals), Q-Q plot of deviance residuals.
3636
7. Write results table (TSV), model summary (text), and diagnostic plots (PDF) to output directory.
3737
8. Report overdispersion finding and family choice justification.
38+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3839

3940
## Output Contract
4041

4142
- Coefficient table (TSV): term, estimate, std_error, z_statistic, p_value, exp_estimate, ci_lower, ci_upper
4243
- Model fit summary (TSV): family, link, null_deviance, residual_deviance, aic, df_residual
4344
- Diagnostic plots (PDF)
4445
- Overdispersion test result (Poisson only, printed to stdout)
46+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4547

4648
## Limits
4749

skills/stat-fit-linear-model/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -33,13 +33,15 @@ description: Fit a linear regression model, report coefficients and model fit, a
3333
6. Generate residual diagnostic plots: (a) residuals vs. fitted, (b) Q-Q plot of residuals, (c) scale-location, (d) Cook's distance.
3434
7. Test regression assumptions: normality of residuals (Shapiro-Wilk), homoscedasticity (Breusch-Pagan), absence of influential points (Cook's distance > 4/n).
3535
8. Write results table (TSV), model summary (text), and diagnostic plots (PDF) to output directory.
36+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3637

3738
## Output Contract
3839

3940
- Coefficient table (TSV): term, estimate, std_error, t_statistic, p_value, ci_lower, ci_upper
4041
- Model fit summary (TSV): r_squared, adj_r_squared, f_statistic, f_p_value, aic, bic, n
4142
- Residual diagnostic plots (PDF, 4-panel)
4243
- Assumption test results (printed to stdout)
44+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4345

4446
## Limits
4547

skills/stat-learn-bayesian-network/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -34,6 +34,7 @@ description: Learn the structure and conditional probabilities of a Bayesian net
3434
6. Visualize the learned DAG: nodes = variables, directed edges = learned dependencies, edge width proportional to bootstrap support.
3535
7. Perform a Markov blanket analysis for each variable (its direct causes, effects, and spouses).
3636
8. Write the DAG adjacency matrix (TSV), CPD parameters (TSV), network plot (PDF), and Markov blanket summary (TSV) to output directory.
37+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3738

3839
## Output Contract
3940

@@ -42,6 +43,7 @@ description: Learn the structure and conditional probabilities of a Bayesian net
4243
- Network visualization (PDF): DAG with node labels and edge confidence
4344
- Markov blanket summary (TSV): variable, parents, children, spouses
4445
- High-confidence edge list (TSV): from, to, bootstrap_support
46+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4547

4648
## Limits
4749

skills/stat-nonlinear-embedding/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -36,12 +36,14 @@ description: Embed high-dimensional data into 2D using t-SNE or UMAP for explora
3636
6. If no metadata: generate plain scatter plot.
3737
7. Report: number of samples embedded, method and parameters used, runtime.
3838
8. Write embedding coordinates (TSV) and scatter plot (PDF) to output directory.
39+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3940

4041
## Output Contract
4142

4243
- Embedding coordinates (TSV): sample_id, dim1, dim2
4344
- Scatter plot (PDF): 2D embedding colored by metadata or uniform color
4445
- Parameters used (printed to stdout): method, all hyperparameters, random seed
46+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4547

4648
## Limits
4749

skills/stat-pairwise-correlation/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -32,6 +32,7 @@ description: Compute pairwise correlations and significance tests across all num
3232
6. Generate a scatter plot matrix (pairs plot) for datasets with ≤ 10 variables.
3333
7. Report the top 20 strongest positive and top 20 strongest negative correlations.
3434
8. Write correlation matrix (TSV), adjusted p-value matrix (TSV), and plots (PDF) to output directory.
35+
9. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3536

3637
## Output Contract
3738

@@ -40,6 +41,7 @@ description: Compute pairwise correlations and significance tests across all num
4041
- Correlation heatmap (PDF)
4142
- Pairs plot (PDF, only if ≤ 10 variables)
4243
- Top correlations summary table (TSV): var1, var2, correlation, p_value, adj_p_value
44+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4345

4446
## Limits
4547

skills/stat-pca/SKILL.md

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -35,6 +35,7 @@ description: Perform PCA on a numeric data matrix to reduce dimensionality, visu
3535
7. Plot PC1 vs. PC2 scatter; if metadata provided, color by specified annotation column; label outlier samples.
3636
8. Report top 20 features with highest absolute loading on PC1 and PC2.
3737
9. Write PC coordinates (TSV), loadings (TSV), variance explained (TSV), scree plot (PDF), and PCA scatter plot (PDF) to output directory.
38+
10. Save the executable analysis script (`analysis_code.py` or `analysis_code.R`) and software version manifest (`session_info.txt`) used to produce results.
3839

3940
## Output Contract
4041

@@ -43,6 +44,7 @@ description: Perform PCA on a numeric data matrix to reduce dimensionality, visu
4344
- Variance explained table (TSV): PC, variance_explained, cumulative_variance
4445
- Scree plot (PDF)
4546
- PCA scatter plot (PDF, PC1 vs. PC2)
47+
- Reproducibility artifacts: `analysis_code.py` or `analysis_code.R`, plus `session_info.txt`
4648

4749
## Limits
4850

0 commit comments

Comments
 (0)