Commit graph

38 commits

Author SHA1 Message Date
Klaus-Uwe Mitterer
003183ed0d Use user_timeline instead of search 2017-03-20 19:05:07 +01:00
Klaus-Uwe Mitterer
549419e831 Add missing import 2017-03-17 22:37:07 +01:00
Klaus-Uwe Mitterer
2c26febb2a Handle videos properly, move downloading function to httptools 2017-03-15 20:43:36 +01:00
Klaus-Uwe Mitterer
eccd79c373 Add oAuth headers to downloadMedia requests in order to download DM attachments 2017-03-07 23:19:11 +01:00
Klaus-Uwe Mitterer
bb1716531a Move fillerfilter to filters.filler 2017-03-07 14:17:21 +01:00
Klaus-Uwe Mitterer
3d55c95bf5 No default output for filler 2017-03-07 13:49:19 +01:00
Klaus-Uwe Mitterer
f71d072d18 Properly handle deleted account 2017-02-27 22:16:29 +01:00
Klaus-Uwe Mitterer
fed45e7b9b Prefix m for media downloaded from direct messages 2017-02-27 00:59:04 +01:00
Klaus-Uwe Mitterer
a7a70d048a Fix stupid copy/paste error 2017-02-27 00:58:01 +01:00
Klaus-Uwe Mitterer
b3b9b26549 Add include_entities for direct messages. Should not do anything, but just to be sure... 2017-02-27 00:57:29 +01:00
Klaus-Uwe Mitterer
fd1d1d5bac Remove duplicated code in getMessages(), implement media download for messages 2017-02-27 00:56:37 +01:00
Klaus-Uwe Mitterer
c015769950 Implement media download in filler 2017-02-27 00:44:50 +01:00
Klaus-Uwe Mitterer
844f92b8c5 Add file downloader to filler 2017-02-27 00:39:34 +01:00
Klaus-Uwe Mitterer
b60125e414 Add fillerfilter file for hooks in filler 2017-02-21 02:27:14 +01:00
Klaus-Uwe Mitterer
f92405092d Fix query for name memory 2017-02-18 20:41:15 +01:00
Klaus-Uwe Mitterer
67d0202b4d Fixed SQL query to properly handle changed handles 2017-02-06 14:49:41 +01:00
Klaus-Uwe Mitterer
701afaef45 Store followers/followings as user IDs rather than handles. Store handles in separate table. 2017-01-30 03:04:51 +01:00
Klaus-Uwe Mitterer
0e580816d8 Added some comments JFF 2017-01-27 22:02:53 +01:00
Klaus-Uwe Mitterer
44ee524ece Forgot that NULL values are actually always seen as distinct values in SQL. Why does SQLite even allow NULL in PRIMARY KEY? 2016-08-09 00:19:29 +02:00
Klaus-Uwe Mitterer
6b443f71c9 Make sure that filler won't fail on first run because of empty data sets 2016-08-07 17:11:22 +02:00
Klaus-Uwe Mitterer
21c90eb394 Convert generator to list for getFollowers()/getFollowing()
Fix SQL query in getFollowing()
2016-08-05 23:20:18 +02:00
Klaus-Uwe Mitterer
98afc3bffd Whatever it is that keeps going wrong, I hate it. And I have to try mitigating it. 2016-08-05 23:13:31 +02:00
Klaus-Uwe Mitterer
8381c4469a Fix apparent problems with database objects in filler 2016-08-04 18:17:59 +02:00
Klaus-Uwe Mitterer
3ec4780385 getFollowers()/getFollowing() should not return records where 'until' is not null, i.e. records that are no longer valid 2016-08-03 13:58:19 +02:00
Klaus-Uwe Mitterer
5c22b78347 Oh my, I'm an idiot... 2016-08-02 01:17:08 +02:00
Klaus-Uwe Mitterer
f19f04c415 Nobody cares about the tweet IDs. 2016-08-01 22:07:00 +02:00
Klaus-Uwe Mitterer
f87ad68b8b Optimize follower/following handling, print changes when running filler.py 2016-08-01 21:46:57 +02:00
Klaus-Uwe Mitterer
114fc04b43 Implement following/follower monitoring 2016-08-01 18:02:11 +02:00
Klaus-Uwe Mitterer
aad1531392 Futher preparation for MySQL, which is not working yet though...
Make filler handle direct messages
Add table and functions for direct messages
2016-06-30 12:33:09 +02:00
Klaus-Uwe Mitterer
1c0b3da582 Split up tools to setuptools and twitools. Testing pending. 2016-05-30 20:40:21 +02:00
Klaus-Uwe Mitterer
367b4e7864 Fixed filler dependencies 2016-04-08 00:15:21 +02:00
Klaus-Uwe Mitterer
7af8c609d0 Changed config system 2015-10-11 00:10:57 +02:00
Klaus-Uwe Mitterer
4371ba7b41 Remove the "coding" lines at the beginning of the file 2015-04-27 18:28:16 +02:00
Klaus-Uwe Mitterer
4fd256cde3 Make filler use tools 2015-04-22 02:06:32 +02:00
Klaus-Uwe Mitterer
2cc64919fd Allow filler.py to use the external config file
Check in sample config file
2015-04-16 00:53:15 +02:00
Klaus-Uwe Mitterer
af14406224 Convert all scripts to Python 3 2015-04-13 22:58:32 +02:00
Klaus-Uwe Mitterer
284e64daee Add error handling to filler.py, allowing empty databases to be filled
Initial (non-functional) check-in of the CSV to sqlite3 converter
2015-04-13 01:58:32 +02:00
Klaus-Uwe Mitterer
89bccfba67 Check in Twitter Database Tools 2015-03-09 18:32:24 +01:00