tscrape

twitter scraper
git clone git://git.codemadness.org/tscrape
Log | Files | Refs | README | LICENSE

DateCommit messageAuthorFiles+-
2020-06-06 22:08refactor urls into general replacement function and replace some HTML entitiesHiltjo Posthuma1+34-30
2020-06-06 10:51README: some rewordingHiltjo Posthuma1+3-1
2020-06-06 10:47rm code thats not needed anymore and a debug/test commentHiltjo Posthuma1+1-18
2020-06-06 00:23Expand all photos URLsLeonardo Taccari1+27-9
2020-06-05 23:50Expand extended_entities URLs in retweetsLeonardo Taccari1+23-0
2020-06-05 23:40Use extended_entities instead of entitiesLeonardo Taccari1+2-2
2020-06-05 23:11Further expand URLs in retweetsLeonardo Taccari1+16-9
2020-06-05 15:19update man pages a bit for the recent changesHiltjo Posthuma3+14-18
2020-06-05 15:18replace all whitespace by a single spaceHiltjo Posthuma1+1-1
2020-06-05 15:17Fix an off-by-one in printexpand() by leotHiltjo Posthuma1+1-1
2020-06-05 15:16simplify parsejson error checkingHiltjo Posthuma1+2-4
2020-06-05 15:15replace newline to space instead of removing themHiltjo Posthuma1+5-1
2020-06-05 12:51work-in-progress: support the new Twitter siteHiltjo Posthuma12+755-804
2020-06-01 10:17fix typoHiltjo Posthuma1+1-1
2020-05-04 11:37bump version to 0.5Hiltjo Posthuma1+1-1
2020-05-02 13:15style.css: improve horizontal scrolling for long titles/small windowsHiltjo Posthuma1+6-13
2020-03-20 18:09util: printescape(): it's enough to set a flag, no counter neededHiltjo Posthuma1+5-5
2020-03-20 17:37documentation: no need to explicitly set HTTP/1Hiltjo Posthuma2+2-2
2020-03-20 17:18tscrape_update: tiny style fix in commentHiltjo Posthuma1+1-1
2020-03-20 17:15tscrape_html: use a <pre> section per feedHiltjo Posthuma1+3-2
2020-03-20 11:03man page improvements (sync)Hiltjo Posthuma6+65-70
2020-03-20 11:02tscrape_html/tscrape_plain: like sfeed, skip when a timestamp is empty/invalidHiltjo Posthuma2+4-2
2020-03-20 11:01README: don't set LC_ALL for awk exampleHiltjo Posthuma1+1-1
2020-03-20 11:00sync printutf8pad from sfeedHiltjo Posthuma1+18-12
2020-03-19 22:52ignore possible consecutive `js-stream-item' when parsing a single tweetLeonardo Taccari1+2-0
2020-02-23 19:36bump version to 0.4Hiltjo Posthuma1+1-1
2020-02-23 19:18tscrape_update: don't preserve permissions of tmp files by moving, so copyHiltjo Posthuma1+4-3
2020-02-01 14:56cleanup some more includesHiltjo Posthuma2+0-5
2020-02-01 14:30rm example.shHiltjo Posthuma1+0-15
2020-02-01 14:13bump LICENSE to 2020Hiltjo Posthuma1+1-1
2020-02-01 14:13cleanup includes and remove unused fields from struct feedHiltjo Posthuma4+4-10
2020-02-01 14:09style.css: sort propertiesHiltjo Posthuma1+13-13
2020-02-01 14:05README: small changeHiltjo Posthuma1+1-1
2020-02-01 14:03Makefile: simplify Makefile, rm config.mk, use system cflags/ldflagsHiltjo Posthuma2+14-32
2020-02-01 14:02sync XML improvementsHiltjo Posthuma3+14-20
2019-08-18 15:06bump version to 0.3Hiltjo Posthuma1+1-1
2019-08-18 12:01man pages: fix mandoc lint warnings + wording tweaksHiltjo Posthuma4+10-10
2019-08-17 10:10man page documentation for all tools: copied from sfeed and changedHiltjo Posthuma6+326-3
2019-08-02 16:46xml: improve cdata and comment callback logicHiltjo Posthuma1+2-2
2019-08-02 16:33tscrape_update: sync improvements from sfeed_updateHiltjo Posthuma2+10-10
2019-05-12 17:20tscrape_update improvementsHiltjo Posthuma1+69-35
2019-05-12 17:19README: add preface text, list dependenciesHiltjo Posthuma1+31-4
2019-05-12 17:19example: fix typo in nameHiltjo Posthuma1+1-1
2019-05-12 16:58tscrape_update: disable If-Modified-Since by defaultHiltjo Posthuma1+1-1
2019-04-23 19:07bump version to 0.2Hiltjo Posthuma1+1-1
2019-04-23 19:06Makefile: make it simpler to not compile compat objectsHiltjo Posthuma1+15-9
2019-04-23 19:06util.h: remove unused macro ISUTF8Hiltjo Posthuma1+1-2
2019-04-22 12:46README: update, add twitter to Atom exampleHiltjo Posthuma1+19-1
2019-04-22 12:46sync XML improvementsHiltjo Posthuma2+19-14
2019-02-22 12:11Makefile / make dist: there is no TODO fileHiltjo Posthuma1+1-2
2019-02-22 12:09Makefile: add DOCPREFIX for installing docs in ports, use system {C,LD}FLAGSHiltjo Posthuma2+21-16
2019-02-22 12:02xml: remove unnecesary checksHiltjo Posthuma1+16-29
2018-12-18 17:10rename getchar_ignore to getnext_ignoreHiltjo Posthuma1+3-3
2018-12-17 17:55tscrape.1: formatted timestamp field was removed a long time agoHiltjo Posthuma1+0-2
2018-12-17 17:40tscrape_update: remove unused terminated() functionHiltjo Posthuma1+0-4
2018-12-17 17:32ignore incorrect unescaped HTML in <style> or <script> in a better wayHiltjo Posthuma1+37-16
2018-12-17 17:25XML tag parse improvements for PI and end tagsHiltjo Posthuma1+29-23
2018-12-17 17:23Makefile: just use OpenBSD #ifdef for pledge(2)Hiltjo Posthuma2+1-4
2018-12-17 17:16tscrape_update: Sync with sfeed_updateLeonardo Taccari1+65-28
2018-09-07 17:36util: fix UB with ctype functionsHiltjo Posthuma1+3-3
2018-09-07 17:35fix UB with ctype functionsHiltjo Posthuma1+3-2
2018-08-26 13:24remove stdint.h header: not needed anymoreHiltjo Posthuma2+0-2
2018-08-26 13:23xml: sync many XML parser improvementsHiltjo Posthuma2+95-77
2018-05-11 18:24tscrape_plain: include sys/types.hHiltjo Posthuma1+2-0
2018-05-11 18:20update tscrape.1: document formatHiltjo Posthuma1+15-5
2018-05-11 18:20improve Makefile, install tscrape.1Hiltjo Posthuma1+5-20
2018-03-30 12:34bump LICENSEHiltjo Posthuma1+1-1
2018-03-11 23:45remove unused variableHiltjo Posthuma1+0-2
2018-03-11 17:45sync xml improvementsHiltjo Posthuma1+50-40
2017-08-26 13:36improve and simplify ignore tag handlingHiltjo Posthuma1+22-31
2017-08-26 11:43xml: simplify a bitHiltjo Posthuma1+2-3
2017-08-26 10:43simplify ignore tags parsingHiltjo Posthuma1+30-49
2017-08-25 15:51when ignoring then ignore all attribute parsing aswellHiltjo Posthuma1+4-1
2017-08-25 15:44initial support to ignore literals in <script> and <style>Hiltjo Posthuma1+61-9
2017-08-25 15:39v -> c for classname shorthandHiltjo Posthuma1+8-8
2017-08-25 15:36initial video extract supportHiltjo Posthuma1+7-0
2017-08-25 14:37fix data-image-urlHiltjo Posthuma1+3-1
2017-08-13 09:17cleanup: remove baseurl and encoding and some leftovers from sfeedHiltjo Posthuma2+3-4
2017-08-13 09:04tscrape_html: add style.cssHiltjo Posthuma1+66-0
2017-08-13 08:26add tscraperc example fileHiltjo Posthuma1+9-0
2017-08-12 15:47add tscrape_update, tscrape_html format program, update MakefileHiltjo Posthuma4+181-31
2017-08-12 15:23first version of tscrape_htmlHiltjo Posthuma2+165-0
2017-08-12 15:15parse own username and fullname from data, add item username and fullnameHiltjo Posthuma2+38-25
2017-08-12 10:52separate parsing and formatting like sfeedHiltjo Posthuma5+281-76
2017-08-12 10:51store retweet id instead of 0 or 1Hiltjo Posthuma1+5-5
2017-08-12 10:28only print tweet if it has a text and usernameHiltjo Posthuma1+2-1
2017-08-12 10:27reset classname in xmltagend is not neededHiltjo Posthuma1+0-2
2017-08-11 17:29add support of the message/status id and to see if pinned or retweetHiltjo Posthuma1+32-14
2017-08-11 17:29with_replies link is not supported anymore I thinkHiltjo Posthuma2+0-9
2017-08-11 14:15parse classname better, hide u-hidden image links, but show direct image linksHiltjo Posthuma1+16-2
2017-08-11 13:46increase buffer size, separate @username with spacesHiltjo Posthuma1+10-6
2017-08-10 16:02workaround/hack: add whitespace after links...Hiltjo Posthuma1+2-0
2017-05-13 11:49remove unused compat.hHiltjo Posthuma1+0-6
2017-05-13 11:46add example scriptHiltjo Posthuma1+15-0
2017-05-13 11:36revert d3d9b9db6743dce94cc7185abfef32dc0fd56578Hiltjo Posthuma1+1-9
2017-05-13 11:23simplify pledge(2) #ifdefHiltjo Posthuma1+4-8
2017-05-13 11:19encode HTML entities (just in case).Hiltjo Posthuma1+9-1
2016-10-08 09:12config.mk: use -D_DEFAULT_SOURCE for CPPFLAGSHiltjo Posthuma1+1-1
2016-04-23 13:06fix typo due to intense hatred of HTTP2Hiltjo Posthuma1+1-1
2016-04-23 13:03fuck HTTP2Hiltjo Posthuma2+4-4
More commits remaining [...]