Commit graph

51 commits

Author SHA1 Message Date
Niko Storni 9ef1b7800b fix nil ptr? 2022-08-16 02:41:14 +02:00
Niko Storni 57e017ec8f fix some logic
reduce verbosity of debug logs
2022-08-15 21:19:20 +02:00
Niko Storni 42db3782ec fix issue with yt not returning a date 2022-08-11 18:01:55 +02:00
Niko Storni 9d93799d86 account for nil struct 2022-08-11 05:28:06 +02:00
Niko d93f463386
fix odd error with morty's date 2022-08-11 00:33:40 +02:00
Niko Storni e454cdb4c9 fix post live detection
prevent unlisted videos from ever publishing (even if they were public before and we know about them)
fix timestamp on videos
update user agent
2022-08-10 21:26:36 +02:00
Niko Storni 5a01983203 add language to channels
improve logging (timestamps)
retry wallet uploads for 30 minutes
don't fail if the db isn't tracking all publishes
2022-08-09 22:11:42 +02:00
Niko Storni 7ff1a009da remove unused params 2022-01-14 18:49:02 +01:00
Niko Storni 33ee6e4b94 Merge remote-tracking branch 'origin/metadata_fix' 2022-01-14 17:20:22 +01:00
Niko Storni f6cde976a6 fix metadata? 2022-01-06 15:15:04 +01:00
Niko Storni 17944fa46a refactor get video time
remove broken time lookup
refactor quite some code
2021-12-30 13:17:11 -05:00
Niko Storni 3c18ae8de2 add checks for buggy livestreams 2021-12-29 17:47:46 -05:00
Niko Storni 070287716b switch from env vars to a config file
get rid of stupid stuff
simplify S3 configuration
split wallets from blockchain.db and use separate S3 store
fix bugs
2021-11-24 05:54:08 +01:00
Niko Storni 2f15c920d4 speed up playlist listing 2021-06-25 19:16:01 +02:00
Niko Storni 69e6fb51d1 improve error handling 2021-06-18 03:09:19 +02:00
Niko Storni a0fb4e579e fix progressbar
fix videos with leading dash
2021-06-17 19:13:44 +02:00
Niko Storni 519e1e4648 switch to yt-dlp
add progressbars
avoid unnecessary calls to youtube
update user agents
cookies fixes
bug fixes
introduction of new bugs
2021-06-17 17:51:21 +02:00
Niko Storni e985a60761 improve upload time detection 2021-03-01 23:34:19 +01:00
Niko Storni acca80dc70 fix unmarshal issue 2021-02-22 19:46:22 +01:00
Niko Storni 053c618458 fix another bug with youtube-dl 2021-02-22 17:29:52 +01:00
Niko Storni d7e194cb5c update chrome UA
change throttle timeout to 48 hours
2021-02-11 23:44:48 +01:00
Niko Storni 06c43c3f71 use youtube-dlc instead 2020-11-10 18:18:07 +01:00
Niko Storni de798ade36 fix canceled by stopper error 2020-10-07 03:40:19 +02:00
Niko Storni 53e0b7c47b fix bug that messes with counts 2020-09-25 21:44:14 +02:00
Niko Storni 0b002c8228 lots of bug fixes and improvements 2020-08-18 00:03:38 +02:00
Niko Storni a56166ee51 refactor youtube-dl execution process 2020-08-12 19:44:57 +02:00
Niko Storni eb8900c66a don't waste loops
fix a deadlock?
2020-08-12 03:37:18 +02:00
Niko Storni f0280b51b4 fix time parsing for real 2020-08-06 02:12:05 +02:00
Niko Storni 775e4881cb invert logic so that we don't flood slack 2020-08-06 00:30:48 +02:00
Niko Storni ec9f46f552 fix release date bug 2020-08-06 00:25:54 +02:00
Mark Beamer Jr 7f1906d58b
change FPS to float from int 2020-08-05 15:47:53 -04:00
Mark Beamer Jr 5be3551abe
Mark video failed if we cannot get video info instead of failing the sync
Turn on error log after fixing lockup
Try different user agents if calls fail
Prevent double processing a channel in a row, just fail the sync instead
2020-08-05 15:47:53 -04:00
Mark Beamer Jr fc18151d77
Increase max db limit
Increase wallet startup time allotment for big channels
Set FPS to float instead of int
2020-08-05 15:47:53 -04:00
Mark Beamer Jr 13543b20e9
Don't use api unless the video is from the past 5 days, otherwise just use the upload date from youtube donwloader
change interface to int for now known field.
2020-08-05 15:47:53 -04:00
Mark Beamer Jr 4eba7200d8
user agent breaks it 2020-08-05 15:47:53 -04:00
Mark Beamer Jr cd11e82676
Dont always fall through on every error.
Add user agent to calls
2020-08-05 15:47:53 -04:00
Mark Beamer Jr c7c220ecd3
Dont always fall through on every error. 2020-08-05 15:47:53 -04:00
Mark Beamer Jr 4d56339756
fixed appending args 2020-08-05 15:47:53 -04:00
Mark Beamer Jr 140353097e
added logging 2020-08-05 15:47:53 -04:00
Mark Beamer Jr a1caea4a28
added logging 2020-08-05 15:47:53 -04:00
Mark Beamer Jr b1e10e7b09
Add retry on IP failures 2020-08-05 15:47:53 -04:00
Mark Beamer Jr ad27425471
Add ip switching for being blocked 2020-08-05 15:47:53 -04:00
Mark Beamer Jr 81e9378b9d
Add new fall through errors for release time 2020-08-05 15:47:53 -04:00
Mark Beamer Jr 64040ea67a
Add calls to internal-apis and add get released date if available. 2020-08-05 15:47:47 -04:00
Alex Grintsvayg 0eef62b5fd
i made a huge mess. sorry future me, when you're digging through this 2020-07-28 21:34:08 -04:00
Alex Grintsvayg a3dd3dc626
WIP: trying to get the accurate api to work 2020-07-28 12:47:28 -04:00
Alex Grintsvayg f942bf8025
get upload time from https://www.invid-project.eu/tools-and-services/invid-verification-plugin/ 2020-07-28 11:20:22 -04:00
Mark Beamer Jr 8e61cde0a0
turn of std error 2020-07-27 17:31:46 -04:00
Mark Beamer Jr 0bb6b6d833
commit my shit 2020-07-27 17:14:18 -04:00
Mark Beamer Jr e926a2c1f6
Fix quickSync && maxVideos 2020-07-27 15:59:14 -04:00