Using param `limit_claims_per_channel` doesn't return always all claims that would excpected #114

New issue

Open

opened 2022-12-05 17:39:43 +01:00 by keikari · 1 comment

keikari commented

2022-12-05 17:39:43 +01:00

(Migrated from github.com)

I think currently on claim_search hub looks up to 1000 items for specific params.
And if I do claim_search with following params:

"limit_claims_per_channel":1,
"channel_ids": <43-channel_ids>,
"page_size": 36

I may only get 31 items in total(even though there are more claims that could be returned), since there are only claims from 31 different channels in those 1000 items.
If using smaller page_size there are more items that get returned in total. Since it's able to fill more pages, I guess.

This can currently be seen easily on spooky category on Odysee, when ordering by effective amount https://odysee.com/$/spooky?order=top with release_time removed
(44 channel_ids, but only 31 claims returned in total)

I think currently on claim_search hub looks up to 1000 items for specific params. And if I do claim_search with following params: ``` "limit_claims_per_channel":1, "channel_ids": <43-channel_ids>, "page_size": 36 ``` I may only get 31 items in total(even though there are more claims that could be returned), since there are only claims from 31 different channels in those 1000 items. If using smaller `page_size` there are more items that get returned in total. Since it's able to fill more pages, I guess. This can currently be seen easily on spooky category on Odysee, when ordering by effective amount https://odysee.com/$/spooky?order=top with `release_time` removed (44 channel_ids, but only 31 claims returned in total)

tzarebczan commented

2022-12-05 17:52:05 +01:00

(Migrated from github.com)

exact claim search: {"jsonrpc":"2.0","method":"claim_search","params":{"page_size":50,"page":1,"claim_type":["stream","repost","channel"],"no_totals":true,"not_channel_ids":[],"not_tags":["porn","porno","nsfw","mature","xxx","sex","creampie","blowjob","handjob","vagina","boobs","big boobs","big dick","pussy","cumshot","anal","hard fucking","ass","fuck","hentai"],"order_by":["effective_amount"],"remove_duplicates":true,"has_source":true,"limit_claims_per_channel":1,"channel_ids":["76ef5bbd5c42e057e36b2402833111f24c5f9c12","119a2e8c0b50f78d3861636d37c3b44ba8e689b5","c4851557645332a7268fe0340faa656341ec5cb1","6489aa07c4bc480e338dc67071e0895df6af1eda","abf8c3b0426cd89fce01770a569d525c648a92b5","e2773f14ea4b438fa9f8c8e4f962055167f01000","b4ccefa53e0bb5730b56facb9b2ae5ad92c99935","deed21cf85c453e074b95949098fcd0c3dc65d69","4f2e005e8ca6ed57fde10c52571c39e22e1bf27f","468aa10ee3f12f0ba6cf2641f11e558c841f12fa","c32de3d9a336f20fd4f66d67428d0d46cea06d58","5f2a5c14b971a6f5eed0a67dc7af3a3fe5c0b6a4","fccced5026200bc9f0fa836f5159b47dd1d78061","b016d47e56f0914c2b985d83e051d43ebf7d2b52","e1f6a655de964977b5b2c56ba6b67ba434e03da1","05a7f5f90f7d5979d1d151f9d1e2d05b55eb151b","146dac6dcef9bbfe3621879bd76c30825341168a","a475e3dcee2111191eda14af5c6e48e5348bf384","2827bfc459c12d7c6d280cbacee750811291d4ba","4bdda920f2fef4caf8095456f5c071b2d4f4260e","e3199607f9f2bcb89cb0f09ed35747a58fd6c128","af927bd2092e7383789df183ff1eaf95c7041ee9","4a7f6709df6770e0786b04599fb00262a98d220b","239e4068eb8c4607e2b204f7019a73fc97636cad","f626ffc07218fffba49518f64216fdeff5097ce3","fa697814b01cbad882e62eb547cf304ad0494d9e","cfcd968df4fd7523ce48e580bc7adb2536d211d6","7579e81c2457f65c14fcd4d1f288c8f32b332d43","8657e17c43187f989a762b4f54868d693ce5e87a","59cf1673391c88f18d92337d0dafd84681f99371","f6b3124d6914978c59eb39176db1f70659ea854e","9cf01ce2a02d3f180b1e0037b25c2760e191ebfc","450a4952e611f333ac2a5fb08b2a4bb421b4a406","b7829928a5d84e12c8ea07de14456d50862833b8","b712d27bf04554ef115fe139aae3b31474872882","fa3a0dbeb5f8c99fbe2571c60db0c3499096da6e","6fc489b1bc7b44b57cba7b613fac21903e6e75c0","5831f60b25f5b5cb7d8b04c7887aa65949bdb279","a1229255cfe560646813132a561a875b09c6fa64","4b02df3aa8192bf7dab499edfcf8b291ba8dde1f","5df2339835971f101023082851808d73d043e13f","66a5e121b0ff4de4e52a0c765afc3e8816f5c0c1","1438eb1126db6340225d6863467ea25941c19947","3302aa9254ab9b24e913366603242e55858f1d18"],"release_time":">1669651200","duration":">=60","any_languages":["en","none"]},"id":1670258910855}

exact claim search: ``` {"jsonrpc":"2.0","method":"claim_search","params":{"page_size":50,"page":1,"claim_type":["stream","repost","channel"],"no_totals":true,"not_channel_ids":[],"not_tags":["porn","porno","nsfw","mature","xxx","sex","creampie","blowjob","handjob","vagina","boobs","big boobs","big dick","pussy","cumshot","anal","hard fucking","ass","fuck","hentai"],"order_by":["effective_amount"],"remove_duplicates":true,"has_source":true,"limit_claims_per_channel":1,"channel_ids":["76ef5bbd5c42e057e36b2402833111f24c5f9c12","119a2e8c0b50f78d3861636d37c3b44ba8e689b5","c4851557645332a7268fe0340faa656341ec5cb1","6489aa07c4bc480e338dc67071e0895df6af1eda","abf8c3b0426cd89fce01770a569d525c648a92b5","e2773f14ea4b438fa9f8c8e4f962055167f01000","b4ccefa53e0bb5730b56facb9b2ae5ad92c99935","deed21cf85c453e074b95949098fcd0c3dc65d69","4f2e005e8ca6ed57fde10c52571c39e22e1bf27f","468aa10ee3f12f0ba6cf2641f11e558c841f12fa","c32de3d9a336f20fd4f66d67428d0d46cea06d58","5f2a5c14b971a6f5eed0a67dc7af3a3fe5c0b6a4","fccced5026200bc9f0fa836f5159b47dd1d78061","b016d47e56f0914c2b985d83e051d43ebf7d2b52","e1f6a655de964977b5b2c56ba6b67ba434e03da1","05a7f5f90f7d5979d1d151f9d1e2d05b55eb151b","146dac6dcef9bbfe3621879bd76c30825341168a","a475e3dcee2111191eda14af5c6e48e5348bf384","2827bfc459c12d7c6d280cbacee750811291d4ba","4bdda920f2fef4caf8095456f5c071b2d4f4260e","e3199607f9f2bcb89cb0f09ed35747a58fd6c128","af927bd2092e7383789df183ff1eaf95c7041ee9","4a7f6709df6770e0786b04599fb00262a98d220b","239e4068eb8c4607e2b204f7019a73fc97636cad","f626ffc07218fffba49518f64216fdeff5097ce3","fa697814b01cbad882e62eb547cf304ad0494d9e","cfcd968df4fd7523ce48e580bc7adb2536d211d6","7579e81c2457f65c14fcd4d1f288c8f32b332d43","8657e17c43187f989a762b4f54868d693ce5e87a","59cf1673391c88f18d92337d0dafd84681f99371","f6b3124d6914978c59eb39176db1f70659ea854e","9cf01ce2a02d3f180b1e0037b25c2760e191ebfc","450a4952e611f333ac2a5fb08b2a4bb421b4a406","b7829928a5d84e12c8ea07de14456d50862833b8","b712d27bf04554ef115fe139aae3b31474872882","fa3a0dbeb5f8c99fbe2571c60db0c3499096da6e","6fc489b1bc7b44b57cba7b613fac21903e6e75c0","5831f60b25f5b5cb7d8b04c7887aa65949bdb279","a1229255cfe560646813132a561a875b09c6fa64","4b02df3aa8192bf7dab499edfcf8b291ba8dde1f","5df2339835971f101023082851808d73d043e13f","66a5e121b0ff4de4e52a0c765afc3e8816f5c0c1","1438eb1126db6340225d6863467ea25941c19947","3302aa9254ab9b24e913366603242e55858f1d18"],"release_time":">1669651200","duration":">=60","any_languages":["en","none"]},"id":1670258910855}```

No milestone

No project

No assignees

1 participant

Notifications

Due date

The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: LBRYCommunity/hub#114

No description provided.

Using param limit_claims_per_channel doesn't return always all claims that would excpected #114

Using param `limit_claims_per_channel` doesn't return always all claims that would excpected #114