Using param limit_claims_per_channel doesn't return always all claims that would excpected #114

Open
opened 2022-12-05 17:39:43 +01:00 by keikari · 1 comment
keikari commented 2022-12-05 17:39:43 +01:00 (Migrated from github.com)

I think currently on claim_search hub looks up to 1000 items for specific params.
And if I do claim_search with following params:

"limit_claims_per_channel":1,
"channel_ids": <43-channel_ids>,
"page_size": 36

I may only get 31 items in total(even though there are more claims that could be returned), since there are only claims from 31 different channels in those 1000 items.
If using smaller page_size there are more items that get returned in total. Since it's able to fill more pages, I guess.

This can currently be seen easily on spooky category on Odysee, when ordering by effective amount https://odysee.com/$/spooky?order=top with release_time removed
(44 channel_ids, but only 31 claims returned in total)

I think currently on claim_search hub looks up to 1000 items for specific params. And if I do claim_search with following params: ``` "limit_claims_per_channel":1, "channel_ids": <43-channel_ids>, "page_size": 36 ``` I may only get 31 items in total(even though there are more claims that could be returned), since there are only claims from 31 different channels in those 1000 items. If using smaller `page_size` there are more items that get returned in total. Since it's able to fill more pages, I guess. This can currently be seen easily on spooky category on Odysee, when ordering by effective amount https://odysee.com/$/spooky?order=top with `release_time` removed (44 channel_ids, but only 31 claims returned in total)
tzarebczan commented 2022-12-05 17:52:05 +01:00 (Migrated from github.com)

exact claim search: {"jsonrpc":"2.0","method":"claim_search","params":{"page_size":50,"page":1,"claim_type":["stream","repost","channel"],"no_totals":true,"not_channel_ids":[],"not_tags":["porn","porno","nsfw","mature","xxx","sex","creampie","blowjob","handjob","vagina","boobs","big boobs","big dick","pussy","cumshot","anal","hard fucking","ass","fuck","hentai"],"order_by":["effective_amount"],"remove_duplicates":true,"has_source":true,"limit_claims_per_channel":1,"channel_ids":["76ef5bbd5c42e057e36b2402833111f24c5f9c12","119a2e8c0b50f78d3861636d37c3b44ba8e689b5","c4851557645332a7268fe0340faa656341ec5cb1","6489aa07c4bc480e338dc67071e0895df6af1eda","abf8c3b0426cd89fce01770a569d525c648a92b5","e2773f14ea4b438fa9f8c8e4f962055167f01000","b4ccefa53e0bb5730b56facb9b2ae5ad92c99935","deed21cf85c453e074b95949098fcd0c3dc65d69","4f2e005e8ca6ed57fde10c52571c39e22e1bf27f","468aa10ee3f12f0ba6cf2641f11e558c841f12fa","c32de3d9a336f20fd4f66d67428d0d46cea06d58","5f2a5c14b971a6f5eed0a67dc7af3a3fe5c0b6a4","fccced5026200bc9f0fa836f5159b47dd1d78061","b016d47e56f0914c2b985d83e051d43ebf7d2b52","e1f6a655de964977b5b2c56ba6b67ba434e03da1","05a7f5f90f7d5979d1d151f9d1e2d05b55eb151b","146dac6dcef9bbfe3621879bd76c30825341168a","a475e3dcee2111191eda14af5c6e48e5348bf384","2827bfc459c12d7c6d280cbacee750811291d4ba","4bdda920f2fef4caf8095456f5c071b2d4f4260e","e3199607f9f2bcb89cb0f09ed35747a58fd6c128","af927bd2092e7383789df183ff1eaf95c7041ee9","4a7f6709df6770e0786b04599fb00262a98d220b","239e4068eb8c4607e2b204f7019a73fc97636cad","f626ffc07218fffba49518f64216fdeff5097ce3","fa697814b01cbad882e62eb547cf304ad0494d9e","cfcd968df4fd7523ce48e580bc7adb2536d211d6","7579e81c2457f65c14fcd4d1f288c8f32b332d43","8657e17c43187f989a762b4f54868d693ce5e87a","59cf1673391c88f18d92337d0dafd84681f99371","f6b3124d6914978c59eb39176db1f70659ea854e","9cf01ce2a02d3f180b1e0037b25c2760e191ebfc","450a4952e611f333ac2a5fb08b2a4bb421b4a406","b7829928a5d84e12c8ea07de14456d50862833b8","b712d27bf04554ef115fe139aae3b31474872882","fa3a0dbeb5f8c99fbe2571c60db0c3499096da6e","6fc489b1bc7b44b57cba7b613fac21903e6e75c0","5831f60b25f5b5cb7d8b04c7887aa65949bdb279","a1229255cfe560646813132a561a875b09c6fa64","4b02df3aa8192bf7dab499edfcf8b291ba8dde1f","5df2339835971f101023082851808d73d043e13f","66a5e121b0ff4de4e52a0c765afc3e8816f5c0c1","1438eb1126db6340225d6863467ea25941c19947","3302aa9254ab9b24e913366603242e55858f1d18"],"release_time":">1669651200","duration":">=60","any_languages":["en","none"]},"id":1670258910855}

exact claim search: ``` {"jsonrpc":"2.0","method":"claim_search","params":{"page_size":50,"page":1,"claim_type":["stream","repost","channel"],"no_totals":true,"not_channel_ids":[],"not_tags":["porn","porno","nsfw","mature","xxx","sex","creampie","blowjob","handjob","vagina","boobs","big boobs","big dick","pussy","cumshot","anal","hard fucking","ass","fuck","hentai"],"order_by":["effective_amount"],"remove_duplicates":true,"has_source":true,"limit_claims_per_channel":1,"channel_ids":["76ef5bbd5c42e057e36b2402833111f24c5f9c12","119a2e8c0b50f78d3861636d37c3b44ba8e689b5","c4851557645332a7268fe0340faa656341ec5cb1","6489aa07c4bc480e338dc67071e0895df6af1eda","abf8c3b0426cd89fce01770a569d525c648a92b5","e2773f14ea4b438fa9f8c8e4f962055167f01000","b4ccefa53e0bb5730b56facb9b2ae5ad92c99935","deed21cf85c453e074b95949098fcd0c3dc65d69","4f2e005e8ca6ed57fde10c52571c39e22e1bf27f","468aa10ee3f12f0ba6cf2641f11e558c841f12fa","c32de3d9a336f20fd4f66d67428d0d46cea06d58","5f2a5c14b971a6f5eed0a67dc7af3a3fe5c0b6a4","fccced5026200bc9f0fa836f5159b47dd1d78061","b016d47e56f0914c2b985d83e051d43ebf7d2b52","e1f6a655de964977b5b2c56ba6b67ba434e03da1","05a7f5f90f7d5979d1d151f9d1e2d05b55eb151b","146dac6dcef9bbfe3621879bd76c30825341168a","a475e3dcee2111191eda14af5c6e48e5348bf384","2827bfc459c12d7c6d280cbacee750811291d4ba","4bdda920f2fef4caf8095456f5c071b2d4f4260e","e3199607f9f2bcb89cb0f09ed35747a58fd6c128","af927bd2092e7383789df183ff1eaf95c7041ee9","4a7f6709df6770e0786b04599fb00262a98d220b","239e4068eb8c4607e2b204f7019a73fc97636cad","f626ffc07218fffba49518f64216fdeff5097ce3","fa697814b01cbad882e62eb547cf304ad0494d9e","cfcd968df4fd7523ce48e580bc7adb2536d211d6","7579e81c2457f65c14fcd4d1f288c8f32b332d43","8657e17c43187f989a762b4f54868d693ce5e87a","59cf1673391c88f18d92337d0dafd84681f99371","f6b3124d6914978c59eb39176db1f70659ea854e","9cf01ce2a02d3f180b1e0037b25c2760e191ebfc","450a4952e611f333ac2a5fb08b2a4bb421b4a406","b7829928a5d84e12c8ea07de14456d50862833b8","b712d27bf04554ef115fe139aae3b31474872882","fa3a0dbeb5f8c99fbe2571c60db0c3499096da6e","6fc489b1bc7b44b57cba7b613fac21903e6e75c0","5831f60b25f5b5cb7d8b04c7887aa65949bdb279","a1229255cfe560646813132a561a875b09c6fa64","4b02df3aa8192bf7dab499edfcf8b291ba8dde1f","5df2339835971f101023082851808d73d043e13f","66a5e121b0ff4de4e52a0c765afc3e8816f5c0c1","1438eb1126db6340225d6863467ea25941c19947","3302aa9254ab9b24e913366603242e55858f1d18"],"release_time":">1669651200","duration":">=60","any_languages":["en","none"]},"id":1670258910855}```
Sign in to join this conversation.
No milestone
No project
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: LBRYCommunity/hub#114
No description provided.