Skip to content

README.md

Latest commit

 

History

History
30 lines (26 loc) · 858 Bytes

README.md

File metadata and controls

30 lines (26 loc) · 858 Bytes

Twitter listener geoparsing integration

requirements

python packages

  • mordecai (pip install mordecai)
  • spacy english model (python -m spacy download en_core_web_lg)

elasticsearch docker

  • set up
    docker pull elasticsearch:5.5.2
    wget https://s3.amazonaws.com/ahalterman-geo/geonames_index.tar.gz --output-file=wget_log.txt
    tar -xzf geonames_index.tar.gz
  • from directory containing geonames_index docker run -d -p 127.0.0.1:9200:9200 -v $(pwd)/geonames_index/:/usr/share/elasticsearch/data elasticsearch:5.5.2

on_data logic

# init class
from geotagger import VCGeotagger
tagger = VCGeotagger()

# in on_data
city, state = "None", "None"
if dat["place"]:
    city, state = tagger.placetag(dat["place"]["full_name"])
if city == "None" and state == "None":
    city, state = tagger.geotag(location)