TODO.txt

TODO:

0. Fiscal year end date
- I fixed it. Is it working???

1. stock list up to date?



2. Edgar ------------------------

   2.1 check acns on 10-k from 90's -V
   2.2 Move all rake tasks into edgar.rake and edgar.rb -V
   2.3 Extract finantial data from financial reports -V
***2.4 Older text files (2009) have XML data in XmlFileName.
       -> Parse these as xml!

1. fix get eps for stocks. The following stocks do NOT have eps records:
=> ["ABH", "AEI", "ACL", "AYE", "ALY", "ACRE", "ACF", "APO", "AHD", "AVO", "BEZ", "BVF", "BHS", "BF.A", "CBC", "CSFS", "CBF", "DCS", "CNB", "CTV", "CML", "CAL", "CYS", "DHRWI", "DLM", "DYP", "ECT", "FISWD", "FMR", "FRC", "FCEB", "FCEA", "GEOWI", "GLG", "GSL", "GTNA", "GAP", "GEFB", "HCA", "HEW", "HUBA", "HII", "IAR", "IMP", "VLT", "JCG", "JAS", "JWA", "KG", "KVA", "KVB", "LNY", "LEAWI", "LRP", "MX", "MSGY", "MFE", "MDRWI", "NNA", "NTY", "PLAA", "NAL", "PMG", "PLA", "Q", "RYI", "SEMG", "SVR", "TOD", "TRY", "UBP", "VRWD", "VZWI", "VOL", "JWB", "ZL"] 

OR fix price_limit method to not crash on missing eps data (return 0 instead?)

 Have yearly inflation instead of relative inflation. That is, have inflation per year and not from that year until now.
- Fixed. This was done up to and including 2011.

2. Dividends 
Update dividend scraping. and update for all stocks 2011. Dividinds site used for data is now a pay site. Need to hook up scraper to non-pay site.


3. Add nasdaq stocks. I had to manualy add MSFT and INTC

-------eps

Can only get 10 years bakc using the rake command:
$ bundle exec rake eps:get_data[MSFT]

dividends can be gotten via the rake (and method from stock scraper)
$ bundle exec rake dividend:get_data[MSFT]
***However, as of Augost 2011, the website dividend.com no longer provids dividends for free, and these methods/commands do not work.

1) Add search screens for: no earnings deficit, PE, dividend record, good ratios, etc
3) Add logging for failded searches, e.g. if could not get data for a stock


-------- SEC filing retrival ---------

1. Extract reports with SEC tags (instead of explicit string names)
2. Follow links for fiings (SCG fails for a single quarterly report on
this: 2014/Q2 )?

----SP500 data and Market PE Calculation----

Need to check that data is correct, and up to date
0. WHAT TO DO WITH STOCKS WITH MULTIPLE SHARE CLASSES:
   0.1. What to do with BRK.A ticker
   0.2. What to do with GOOG/GOOGL
   0.25 NWSA - NWS (both on sp500)
   0.26 FOX, FOXA   
   0.3. CMCSA
   0.4. GEN
   0.5. HUBB
   0.6  VIA, VIAB(non voting)


0.0) IMPLEMTATION
- Add automatic correct getting of multiple share classes by CPP GRAHAM
The following 68 stocks have multiple share classes:

mysql> select ticker,name from stocks where id in (select distinct stock_id from notes where pertains_to='SHARES_OUTSTANDING' and note="There are MULTIPLE classes of shares for thes stock");

** Get xml from 2009 requires an xml parser

TODO:

1. FIX divs and splits auto getting

2. Create cron autoupdate:
   General:
   - Run (in cpp) cron autoupdate for update financials IFF latest data
older than 3 months, and write log on run -VVV
   - Update divs and splits - update firefox/selenium
   - Update prices - added class method -VVV
   - Run calculations and save results to file ->
                    -> Move calculation into SpEarnings class

3. (Jan 2016)
Selenium webcrawler seems to not work.
FIX getting of dividends and splits


4. Add trendline to earnings:
   to highcharts:
   https://github.com/virtualstaticvoid/highcharts_trendline
   How to get slope value:

5. Track record of earning misses

6. -Add html talbe sort to data/sppe results table.
   -Make nicer display for sp/index
   
7. Add data of report filed, so that can backtrack ttm from the past
8. Refactor sp500 list, as a query on Stock, 
   Move sppe method to stocks controller
   Use Stock objects instead of SpData in sppe results

** Some error with getting correct date for PRGO reports