Skip to content
Open
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
134 commits
Select commit Hold shift + click to select a range
1722cf5
Added building energy data analysis project
WillKoehrsen Dec 13, 2017
e1a6121
Added Random Forest rest Explained
WillKoehrsen Dec 27, 2017
671d78e
Random Forest Explained Materials
WillKoehrsen Dec 27, 2017
b5c3930
Improved plotting and added titles to align with article
WillKoehrsen Dec 29, 2017
6f1db97
Update Jupyter Notebook code
WillKoehrsen Dec 29, 2017
2aabffa
Working on Improving the Random Forest
WillKoehrsen Jan 7, 2018
f54e7a6
Updated Jupyter Notebook for Improving Random Forest Part 1
WillKoehrsen Jan 7, 2018
e6c0d08
Reorganizing projects
WillKoehrsen Jan 7, 2018
a4abdda
Weight Loss Challenge Data Analysis
WillKoehrsen Jan 8, 2018
e3735f1
Working on Hyperparameter tuning with the Random Forest
WillKoehrsen Jan 9, 2018
1de9d53
Reorganization of materials
WillKoehrsen Jan 10, 2018
311c0e1
Working on additive models in Python
WillKoehrsen Jan 12, 2018
8e55c90
Finished notebook for additive models: introduction
WillKoehrsen Jan 13, 2018
1dc512d
Updated Notebook and images
WillKoehrsen Jan 13, 2018
3876db6
Separated stock predictions into different jupyter notebook
WillKoehrsen Jan 13, 2018
067135d
Stock Predictor Working (but clearly not making money
WillKoehrsen Jan 13, 2018
b9d0e1a
Working on plotting stock predictions
WillKoehrsen Jan 13, 2018
82c6b70
Finished Plotting
WillKoehrsen Jan 14, 2018
dd63f77
Finished up Jupyter Notebook
WillKoehrsen Jan 14, 2018
a9bfd29
Time for the writing!
WillKoehrsen Jan 14, 2018
f1ed857
Working on predictions one day at a time
WillKoehrsen Jan 14, 2018
386d5c4
Modified introdintroduction to additive models to show effect of priors
WillKoehrsen Jan 15, 2018
1b38295
Finished modifying time series introduction
WillKoehrsen Jan 15, 2018
c4ccecb
Working on making stock predictor class
WillKoehrsen Jan 15, 2018
2e94516
Working on documentation
WillKoehrsen Jan 15, 2018
403ac56
Finished basic methods for stocker class
WillKoehrsen Jan 15, 2018
51ed805
Added predict range and changepoint analysis
WillKoehrsen Jan 16, 2018
59b520d
Incorporated Google Trends in to Class
WillKoehrsen Jan 16, 2018
63b24d2
Working on testing
WillKoehrsen Jan 16, 2018
3aead92
Working on documentation (readme)
WillKoehrsen Jan 16, 2018
134c060
Documentation almost complete
WillKoehrsen Jan 16, 2018
789d95c
Completed preliminary version of readme
WillKoehrsen Jan 16, 2018
7877f25
Minor adjustments to readme for clarification.
WillKoehrsen Jan 16, 2018
1bf6e74
Update readme.md
WillKoehrsen Jan 16, 2018
9ebca1d
Update readme.md
WillKoehrsen Jan 16, 2018
40fb7d7
Update readme.md
WillKoehrsen Jan 16, 2018
96d5236
Added working version of stocker
WillKoehrsen Jan 16, 2018
afde165
Update readme.md
WillKoehrsen Jan 16, 2018
95f82df
Update readme.md
WillKoehrsen Jan 16, 2018
652989e
Fixed evaluation output and documentation
WillKoehrsen Jan 16, 2018
ff9996b
Merge branch 'master' of https://github.com/ColonelSherburn/Data-Anal…
WillKoehrsen Jan 16, 2018
4efbe79
Added titles for method sections.
WillKoehrsen Jan 16, 2018
2470fca
Added option to specify data range for evaluate prediction method
WillKoehrsen Jan 16, 2018
22ad673
Added ability to select date range to evaluate prediction method
WillKoehrsen Jan 16, 2018
2552547
Fixed some issues with plotting and analysis
WillKoehrsen Jan 17, 2018
83bcad1
Merge branch 'master' of https://github.com/ColonelSherburn/Data-Anal…
WillKoehrsen Jan 17, 2018
ccebce1
Expanded plot_stock options
WillKoehrsen Jan 17, 2018
d94781c
Working on Analysis Usage Notebook
WillKoehrsen Jan 17, 2018
9189957
Cleaned up Stock Explorer Class notebook
WillKoehrsen Jan 17, 2018
8b14df5
Done with Analysis Aris Article
WillKoehrsen Jan 17, 2018
1684c38
Update readme.md
WillKoehrsen Jan 17, 2018
d34f752
Started Stocker Prediction sage notebook
WillKoehrsen Jan 18, 2018
d06645e
Added list of all available stocks
WillKoehrsen Jan 18, 2018
79b0215
Update readme.md
WillKoehrsen Jan 18, 2018
25ed48b
Removed quandl api key
WillKoehrsen Jan 18, 2018
9d696d9
Reorganized
WillKoehrsen Jan 18, 2018
2b631bf
Merge branch 'master' of https://github.com/WillKoehrsen/Data-Analysis
WillKoehrsen Jan 18, 2018
970eb5e
Writing Notebook for preidction usage
WillKoehrsen Jan 19, 2018
308dd20
SeSet changepoint prior scale to default value in prophet library
WillKoehrsen Jan 19, 2018
6d92739
Improved Metrics for Accuracy Function
WillKoehrsen Jan 19, 2018
393a023
Added option to change the number of training years
WillKoehrsen Jan 19, 2018
2a19995
Completed Prediction Usage Notebook
WillKoehrsen Jan 19, 2018
36dc96e
Working on Article for Predicion
WillKoehrsen Jan 19, 2018
6659713
Changed evaluate method to use validation set
WillKoehrsen Jan 19, 2018
39af474
Finished article about prediction
WillKoehrsen Jan 19, 2018
e93c6bc
Jupyter Notebook for Prediction completed
WillKoehrsen Jan 19, 2018
b451bd2
Revised readme to reflect improved validation.
WillKoehrsen Jan 19, 2018
611b4bd
Added weighter project
WillKoehrsen Jan 20, 2018
ff82fa1
Merge branch 'master' of https://github.com/WillKoehrsen/Data-Analysis
WillKoehrsen Jan 20, 2018
6da5c3f
Create readme.md
WillKoehrsen Jan 20, 2018
e33c872
Finished summary method
WillKoehrsen Jan 20, 2018
2027a10
Merge branch 'master' of https://github.com/WillKoehrsen/Data-Analysis
WillKoehrsen Jan 20, 2018
64b39e8
Removed api key
WillKoehrsen Jan 20, 2018
19979f6
Removed api tokens and moved to local access
WillKoehrsen Jan 20, 2018
f624f10
Have percentage plot and history plot methods working
WillKoehrsen Jan 21, 2018
fc15abe
Added Google Sheets updating for weighter
WillKoehrsen Jan 21, 2018
a6399da
Added analysis message
WillKoehrsen Jan 21, 2018
1a25aca
Automatic updates working fine
WillKoehrsen Jan 21, 2018
7d229f0
Fixed plotting issues
WillKoehrsen Jan 21, 2018
f159ec4
Fixed Weighter Application
WillKoehrsen Jan 23, 2018
10fcfb3
Added date handling
WillKoehrsen Jan 23, 2018
74553f9
Fixed date handling issues
WillKoehrsen Jan 23, 2018
42b36b0
Finished reworking date selection
WillKoehrsen Jan 23, 2018
6076908
Weight Tracker ready for public showcase
WillKoehrsen Jan 23, 2018
e117e1a
Weighter working with slack
WillKoehrsen Jan 24, 2018
2837476
Completed Over vs Underfitting Notebook
WillKoehrsen Jan 27, 2018
72e41eb
Edited Over vs Under fitting for article
WillKoehrsen Jan 27, 2018
70d9eb4
Images for articles
WillKoehrsen Jan 27, 2018
5b30db0
Adjusted order of notebook cells
WillKoehrsen Jan 28, 2018
2c39e6b
Completed article
WillKoehrsen Jan 28, 2018
1c0a5e0
Started looking at other exchanges
WillKoehrsen Jan 31, 2018
b26ac7a
Stocker now supports BSE and NSE exchanges
WillKoehrsen Jan 31, 2018
6ebc5e3
Reflect additional exchanges now available
WillKoehrsen Jan 31, 2018
46ebbf2
Statistical Significance
WillKoehrsen Feb 2, 2018
a4303e6
Merge branch 'master' of https://github.com/WillKoehrsen/Data-Analysis
WillKoehrsen Feb 2, 2018
6dfeddf
Multiple Comparisons
WillKoehrsen Feb 6, 2018
7588834
Bonferroni Correction
WillKoehrsen Feb 7, 2018
67ae7fa
Recall and precision article
WillKoehrsen Mar 3, 2018
7a80faf
Web Automation with Python
WillKoehrsen Mar 10, 2018
84f2d09
Submission Clip
WillKoehrsen Mar 10, 2018
073d73b
Finished article on web automation
WillKoehrsen Mar 11, 2018
c008caf
Starting UnivaHistogram and Density Plot
WillKoehrsen Mar 21, 2018
77b57da
Finished density Bokeh plot
WillKoehrsen Mar 21, 2018
5ec2f43
Working on Article about Histograms and Density Plots in Python
WillKoehrsen Mar 23, 2018
8cceb93
Completed Notebook for aritcle on Histograms and Density Plots
WillKoehrsen Mar 23, 2018
939ec77
Completed Article foror Histograms and Density Plots
WillKoehrsen Mar 24, 2018
1d66fec
Starting Work on Bayesian Linear Regression
WillKoehrsen Apr 3, 2018
04369f8
Started on Pair Plots notebook for article
WillKoehrsen Apr 4, 2018
d31b690
Working on Pair Plots Jupyter Notebook:
WillKoehrsen Apr 6, 2018
2796149
Slight modifications for article
WillKoehrsen Apr 6, 2018
c6991c8
Final version of notebook for article
WillKoehrsen Apr 6, 2018
c061c5d
Bayesian Linear Regression Explanation
WillKoehrsen Apr 12, 2018
e1a73ad
Working on explanation of Bayesian linear regression
WillKoehrsen Apr 13, 2018
aa35b2b
Bayesian Linear Regression
WillKoehrsen Apr 13, 2018
7bfb857
Working on Bayesian Linear Regression Project
WillKoehrsen Apr 20, 2018
499f65a
Finished Notebook for Bayesian Machine Learning Project
WillKoehrsen Apr 20, 2018
b21d462
Bayesian Linear Regression Project
WillKoehrsen Apr 20, 2018
115ef6e
Add files via upload
WillKoehrsen May 4, 2018
97f3d2e
Delete 2016_nyc_benchmarking_data_disclosure_definitions.pdf
WillKoehrsen May 4, 2018
57519d9
Delete cortex_data.csv
WillKoehrsen May 4, 2018
3b6552c
Delete cleaned_data.csv
WillKoehrsen May 4, 2018
fdd8f28
Delete Exploratory Work.ipynb
WillKoehrsen May 4, 2018
dbe1296
Delete Building Data Report.pdf
WillKoehrsen May 4, 2018
bf433f1
Delete Building Data Report.ipynb
WillKoehrsen May 4, 2018
4cec5b4
Create filename.md
WillKoehrsen May 4, 2018
8da2741
Add files via upload
WillKoehrsen May 4, 2018
c82b977
Delete raw_data.csv
WillKoehrsen May 4, 2018
8076cf5
Delete filename.md
WillKoehrsen May 4, 2018
b79153b
Add files via upload
WillKoehrsen May 4, 2018
ac22b46
Update README.md
WillKoehrsen May 4, 2018
9a498fa
Update README.md
WillKoehrsen May 4, 2018
20cc74a
Delete Exploratory Work.ipynb
WillKoehrsen May 7, 2018
dbd0e11
Add files via upload
WillKoehrsen May 7, 2018
00d415d
Moved data science hw to machine learning projects repo
WillKoehrsen May 13, 2018
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
6 changes: 6 additions & 0 deletions .ipynb_checkpoints/Untitled1-checkpoint.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1,6 @@
{
"cells": [],
"metadata": {},
"nbformat": 4,
"nbformat_minor": 2
}
183 changes: 183 additions & 0 deletions .ipynb_checkpoints/canvas_upload-checkpoint.ipynb
Original file line number Diff line number Diff line change
@@ -0,0 +1,183 @@
{
"cells": [
{
"cell_type": "code",
"execution_count": 16,
"metadata": {},
"outputs": [],
"source": [
"import selenium\n",
"from selenium import webdriver\n",
"import os"
]
},
{
"cell_type": "code",
"execution_count": 20,
"metadata": {},
"outputs": [],
"source": [
"file_dict = {}\n",
"class_dir = 'C:/Users/Will Koehrsen/Desktop/class_submissions'\n",
"dir_list = list(os.listdir(class_dir))\n",
"for directory in dir_list:\n",
" file_dict[directory] = list(os.listdir(os.path.join(class_dir, directory)))"
]
},
{
"cell_type": "code",
"execution_count": 21,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"{'DSCI451': ['DSCI452_SemProj_Plan.txt'],\n",
" 'DSCI453': [],\n",
" 'EECS491': [],\n",
" 'EECS531': []}"
]
},
"execution_count": 21,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"file_dict"
]
},
{
"cell_type": "code",
"execution_count": 2,
"metadata": {},
"outputs": [],
"source": [
"driver = webdriver.Chrome()"
]
},
{
"cell_type": "code",
"execution_count": 6,
"metadata": {},
"outputs": [],
"source": [
"with open('C:/Users/Will Koehrsen/Desktop/cp.txt', 'r') as f:\n",
" cp = f.read()\n",
" \n",
"driver.get('https://canvas.case.edu')"
]
},
{
"cell_type": "code",
"execution_count": 8,
"metadata": {},
"outputs": [],
"source": [
"id_box = driver.find_element_by_name('username')\n",
"pass_box = driver.find_element_by_name('password')\n",
"login_button = driver.find_element_by_name('submit')"
]
},
{
"cell_type": "code",
"execution_count": 9,
"metadata": {},
"outputs": [],
"source": [
"id_box.send_keys('wjk68')\n",
"pass_box.send_keys(cp)\n",
"login_button.click()"
]
},
{
"cell_type": "code",
"execution_count": 11,
"metadata": {},
"outputs": [],
"source": [
"courses_button = driver.find_element_by_id('global_nav_courses_link')\n",
"courses_button.click()"
]
},
{
"cell_type": "code",
"execution_count": 12,
"metadata": {},
"outputs": [],
"source": [
"file = '03/09_Weekly_Update.Rmd'\n"
]
},
{
"cell_type": "code",
"execution_count": 15,
"metadata": {},
"outputs": [
{
"data": {
"text/plain": [
"'03/09 Weekly Update'"
]
},
"execution_count": 15,
"metadata": {},
"output_type": "execute_result"
}
],
"source": [
"file.replace('_', ' ').split('.')[0]"
]
},
{
"cell_type": "code",
"execution_count": null,
"metadata": {},
"outputs": [],
"source": [
"for folder, files in file_dict.items():\n",
" if folder == 'DSCI451':\n",
" class_select = driver.find_element_by_link_text('Applied Data Science Research')\n",
" elif folder == 'DCSI453':\n",
" class_select = driver.find_element_by_link_text('Data Science: Statistical Learning, Modeling and Prediction')\n",
" elif folder == 'EECS491':\n",
" class_select = driver.find_element_by_link_text('Artificial Intelligence: Probabilistic Graphical Models')\n",
" elif folder == 'EECS531':\n",
" class_select = driver.find_element_by_link_text('Computer Vision')\n",
" class_select.click()\n",
" assignment_button = driver.find_element_by_link_text('Assignments')\n",
" assignment_button.click()\n",
" for file in files:\n",
" find_file = file.replace('_', ' ').split('.')[0]\n",
" specific_assigment = driver.find_element_by_link_text(find_file)\n",
" specific_assigment.click()\n",
" submit_assignment_button = driver.find_element_by_link_text('Submit Assignment')\n",
" submit_assignment_button.click()\n",
" choose_file = driver.find_element_by_name('attachments[0][uploaded_data]')\n",
" choose_file.send_keys('C:/Users/Will Koehrsen/Desktop/class_submissions/%s/%s' % (folder, file)).accept()\n",
" final_submission_button = driver.find_element_by_link_text('Submit Assignment')"
]
}
],
"metadata": {
"kernelspec": {
"display_name": "Python 3",
"language": "python",
"name": "python3"
},
"language_info": {
"codemirror_mode": {
"name": "ipython",
"version": 3
},
"file_extension": ".py",
"mimetype": "text/x-python",
"name": "python",
"nbconvert_exporter": "python",
"pygments_lexer": "ipython3",
"version": "3.6.4"
}
},
"nbformat": 4,
"nbformat_minor": 2
}
17 changes: 0 additions & 17 deletions R Statistics/Linear Regression.R

This file was deleted.

8 changes: 6 additions & 2 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,4 +1,8 @@
# Data-Analysis
Data Analysis Using R and Python
Data Analysis Using Python and a little R.

A place to share my code for various data analysis projects, both personal, and research project related.
A place to share my code and reports for various data science projects.

Many of these projects are written up on my [Towards Data Science Medium page](https://medium.com/@williamkoehrsen).

Reach me on Twitter [@koehrsen_will](https://twitter.com/@koehrsen_will)
Loading