Web Crawler with R Basic

Week1

Syllabus

• Packages
  • install.packages
  • library
• Example: TWSE
  • demo
• 爬蟲心法
• 爬蟲小幫手 (GUI 工具)
• HTTP
• GET Method
• GET Request by Postman
• Parsor for Files
• The Architecture of a Crawler
• R Basic
• Homework

---

Week2

Syllabus

• Post Method in Practice
• Bad CSV
• Ajax
• WebDriver (RSelenium)
• Homework

---

Week3

Syllabus

• Database
  • SQL
  • NoSQL
    • Redis
    • MongoDB

---

Week4

Visualization & Reporting

• ggplot2
• dplyr
• Shiny