evanferrao
/
dump-mirrorbot
mirror of https://github.com/Box-boi/dump-mirrorbot.git
1
0
Fork 0
Code Issues Actions Packages Projects Releases Wiki Activity
287 Commits 2 Branches 21 Tags 2 MiB
Commit Graph

40 Commits

Author SHA1 Message Date
jaskaranSM c6a430a44d Handle more exceptions 2020-06-18 12:59:52 +05:30
jaskaranSM 3720eacf13 Optimize Clone implementation 2020-06-18 12:57:31 +05:30
lzzy12 c791b39785 Revert "Improved upload progress implementation" 
This reverts commit 0f7b79f7a4.
 2020-06-05 13:20:40 +05:30
lzzy12 0f7b79f7a4 Improved upload progress implementation 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-05-21 13:08:50 +05:30
jaskaranSM 315108e7d1 patch regex for more links 2020-05-05 10:51:55 +05:30
jaskaranSM 4d964b6e29 use regex to extract fileId from GDrive links 2020-05-04 12:25:40 +05:30
jaskaranSM 120ca7538d clone: remove forward slash 2020-04-16 12:39:46 +05:30
jaskaranSM e5bb8e55ef Clone fix and added index link support 2020-04-16 12:38:12 +05:30
jaskaranSM d7bc8f3c9a switch to context based callbacks 2020-04-16 12:26:28 +05:30
Arsalan ed60afa9d6
fix typo in INDEX_URL (#54) 2020-04-07 20:36:04 +05:30
lzzy12 47dd3c2b6f gdriveTools: Handle unhandled exception in clone method 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-04-05 14:12:13 +05:30
lzzy12 a54fc42e1e Handle some exceptions 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-31 15:42:13 +05:30
jaskaranSM be9c64a9aa Use Service Accounts for Cloning if availble. 
- increase default timeout for network socket interface

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-25 18:00:33 +05:30
jaskaranSM 08a71e4bd4 TeamDrive List fix 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 18:57:10 +05:30
lzzy12 6ca2f479d5 Fix up errors after porting service accounts from develop 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 16:30:03 +05:30
lzzy12 25856bfac0 gdrive: Stop spamming logs at INFO log level 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 15:49:04 +05:30
jaskaranSM 8d1bf5aa92 recursively try again instead of handling switch with backoff 
- Handling service account switching with exponential backoff implementation limits the number of service accounts to be used. recursively retrying again after switch doesnt effect backoff.

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 15:41:59 +05:30
jaskaranSM 6cd59d5a15 Cleanup drive_list and minor fixes 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 15:39:57 +05:30
jaskaranSM 681b8bd47d Added missing property 2020-03-24 15:07:45 +05:30
jaskaranSM 2bbfca0496 Refactor service account implementation 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 15:07:23 +05:30
lzzy12 7ad7d9388a Add support for service account 
Adding support service accounts

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>

Added scripts and docs for generating service accounts

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>

gen_sa_accounts: Save credentials with indexed file name

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>

gdriveTools: Avoid using oauth2 library for service accounts

oauth2 library is deprecated

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-24 15:04:24 +05:30
jaskaranSM 997e572b69 Enable TeamDrive support for clone 2020-03-24 14:17:50 +05:30
lzzy12 b4b0dcd3f8 Improve logic for parsing id from gdrive url 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-22 15:05:12 +05:30
jaskaranSM 6b60ca4491 Squash of clone command 
Implement clone feature
- clones a public/driveAccountAccessible Drive Link to bot G-Drive

use BotCommands for clone command trigger
 2020-03-22 15:05:11 +05:30
lzzy12 898977df97 Use proper url-encoding methods to replace special characters from url 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-03-20 17:03:33 +05:30
lzzy12 2fddd06178 Fixed upload of empty files for Team Drive 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-02-05 02:49:54 -08:00
Shivam Jha 5c1a9c71b7
gdriveTools: Hardcode interval for updating progress 2020-01-17 01:34:52 -08:00
Shivam Jha 00a8e57467
Fixed error in gdrivetools 2020-01-10 17:36:51 +05:30
lzzy12 326129fdeb Make Oauth Scope a list as it should be 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-01-04 07:42:55 +05:30
lzzy12 e5f997d1f3 Revert "Fixed potential race conditions in GoogleDriveHelper class" 
This reverts commit 20dae25dc9.

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2020-01-03 10:41:54 +05:30
jaskaranSM 7b2d5d50ab Implement Exponential Backoff 
- for handling Google Drive API errors such as 5xx,4xx
 2020-01-03 10:15:40 +05:30
lzzy12 20dae25dc9 Fixed potential race conditions in GoogleDriveHelper class 
* Also simplified code a bit
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-26 16:39:59 +05:30
lzzy12 820d72f317 Fixed files not being shown which were not uploaded by bot 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-26 14:47:05 +05:30
lzzy12 4e1f7a8a77 Small optimisations all around 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 16:40:43 +05:30
lzzy12 8e886a3030 Add Index URL in /list cmd 
Also simplified code a bit

Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 15:53:43 +05:30
lzzy12 53b6829235 Fixed Team Drive list functionality 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-25 15:15:36 +05:30
jaskaranSM 8a516024cb Fixed Folder upload to Team Drives 2019-12-24 21:11:33 +05:30
lzzy12 b31a39f11a Enable TeamDrive support 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 20:12:39 +05:30
lzzy12 0ed1ca3531 Enable TeamDrive support 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 19:49:48 +05:30
lzzy12 82ae49a33a Re implement upload progress after rebase 
Signed-off-by: lzzy12 <jhashivam2020@gmail.com>
 2019-12-24 17:24:35 +05:30
Renamed from bot/helper/mirror_utils/gdriveTools.py (Browse further)