LBRYCommunity/hub
1
0
Fork 0
Code Issues 35 Pull requests 6 Projects Releases Packages Wiki Activity

missing claim search entries - reposts + fee amount #75

New issue
Open
opened 2022-06-27 17:27:13 +02:00 by tzarebczan · 5 comments
tzarebczan commented 2022-06-27 17:27:13 +02:00 (Migrated from github.com)
Copy link

i.e.

{"jsonrpc":"2.0","method":"claim_search","params":{"page_size":20,"page":1,"claim_type":["stream","repost"],"no_totals":true,"not_tags":[],"order_by":["release_time"],"has_source":true,"fee_amount":">=0","channel_ids":["0739af4338a3e9c2307c4170107b30c0af1e1a1f"],"release_time":"<1656102420","include_purchase_receipt":true},"id":1656102468406}

is missing: https://odysee.com/@Cahlen:0/CahlenLee_20220623_DefiningHarm:4

i.e. {"jsonrpc":"2.0","method":"claim_search","params":{"page_size":20,"page":1,"claim_type":["stream","repost"],"no_totals":true,"not_tags":[],"order_by":["release_time"],"has_source":true,"fee_amount":">=0","channel_ids":["0739af4338a3e9c2307c4170107b30c0af1e1a1f"],"release_time":"<1656102420","include_purchase_receipt":true},"id":1656102468406} is missing: https://odysee.com/@Cahlen:0/CahlenLee_20220623_DefiningHarm:4
tzarebczan commented 2022-07-25 16:35:01 +02:00 (Migrated from github.com)
Copy link

This ended up being a bug due to fee amount filter - it works without it. Removed for now, but this should be fixed.

This ended up being a bug due to fee amount filter - it works without it. Removed for now, but this should be fixed.
moodyjon commented 2022-08-12 01:43:41 +02:00 (Migrated from github.com)
Copy link

Could be similar to https://github.com/lbryio/herald.go/issues/40

Could be similar to https://github.com/lbryio/herald.go/issues/40
moodyjon commented 2022-08-15 18:27:53 +02:00 (Migrated from github.com)
Copy link

I could not reproduce this against the production hubs using production SDK:

swdev1@Jonathans-Mac-mini herald % curl -v -X POST -H 'Content-Type: application/json' -d '{"jsonrpc":"2.0","method":"version","params":{}}' localhost:5279
Note: Unnecessary use of -X or --request, POST is already inferred.
*   Trying 127.0.0.1:5279...
* Connected to localhost (127.0.0.1) port 5279 (#0)
> POST / HTTP/1.1
> Host: localhost:5279
> User-Agent: curl/7.79.1
> Accept: */*
> Content-Type: application/json
> Content-Length: 48
> 
* Mark bundle as not supporting multiuse
< HTTP/1.1 200 OK
< Content-Type: application/json; charset=utf-8
< Content-Length: 288
< Date: Mon, 15 Aug 2022 16:17:42 GMT
< Server: Python/3.7 aiohttp/3.7.4
< 
{
  "jsonrpc": "2.0",
  "result": {
    "build": "release",
    "lbrynet_version": "0.107.2",
    "os_release": "21.5.0",
    "os_system": "Darwin",
    "platform": "Darwin-21.5.0-x86_64-i386-64bit",
    "processor": "i386",
    "python_version": "3.7.13",
    "version": "0.107.2"
  }
}

The stream was found:

curl -v -X POST -H 'Content-Type: application/json' -d '{"jsonrpc":"2.0","method":"claim_search","params":{"page_size":20,"page":1,"claim_type":["stream","repost"],"no_totals":true,"not_tags":[],"order_by":["release_time"],"has_source":true,"fee_amount":">=0","channel_ids":["0739af4338a3e9c2307c4170107b30c0af1e1a1f"],"release_time":"<1656102420","include_purchase_receipt":true},"id":1656102468406}' localhost:5279

      {
        "address": "bKN8Pb8MFvxvJf98S8wTVF1J2DYjMdqCJM",
        "amount": "1.11",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_DefiningHarm#4",
        "claim_id": "4bc3518087f23fc0b83e84119bd30f7edb550e39",
        "claim_op": "create",
        "confirmations": 28381,
        "height": 1181280,
        "is_channel_signature_valid": true,
        "meta": {
          "activation_height": 1181280,
          "creation_height": 1181280,
          "creation_timestamp": 1656016895,
          "effective_amount": "1.18941973",
          "expiration_height": 3283680,
          "is_controlling": true,
          "reposted": 1,
          "support_amount": "0.07941973",
          "take_over_height": 1181280
        },
        "name": "CahlenLee_20220623_DefiningHarm",
        "normalized_name": "cahlenlee_20220623_definingharm",
        "nout": 0,
        "permanent_url": "lbry://CahlenLee_20220623_DefiningHarm#4bc3518087f23fc0b83e84119bd30f7edb550e39",
        "short_url": "lbry://CahlenLee_20220623_DefiningHarm#4",
        "signing_channel": {
          "address": "bCmHHBREHNSURY4x2thRARWeQjMyw3nCa7",
          "amount": "50.0",
          "canonical_url": "lbry://@Cahlen#0",
          "claim_id": "0739af4338a3e9c2307c4170107b30c0af1e1a1f",
          "claim_op": "update",
          "confirmations": 92369,
          "has_signing_key": false,
          "height": 1117292,
          "meta": {
            "activation_height": 1117292,
            "claims_in_channel": 718,
            "creation_height": 691084,
            "creation_timestamp": 1577698690,
            "effective_amount": "1284.957",
            "expiration_height": 3219692,
            "is_controlling": true,
            "reposted": 0,
            "support_amount": "1234.957",
            "take_over_height": 691830
          },
          "name": "@Cahlen",
          "normalized_name": "@cahlen",
          "nout": 0,
          "permanent_url": "lbry://@Cahlen#0739af4338a3e9c2307c4170107b30c0af1e1a1f",
          "short_url": "lbry://@Cahlen#0",
          "timestamp": 1645751675,
          "txid": "e47d3303a96dec612a9f5e245662ea0c0d7be8cbd45659dc16e0a797a0dda4cd",
          "type": "claim",
          "value": {
            "cover": {
              "url": "https://thumbnails.lbry.com/banner-UCXgiWdSbAapi_Z_RNUur0iA"
            },
            "description": "Modern Day Wizard\nhttps://cahlen.org",
            "email": "mail@cahlen.org",
            "locations": [
              {
                "country": "US"
              }
            ],
            "public_key": "3056301006072a8648ce3d020106052b8104000a03420004a5bbee1dac43cccd68681ce1e57b860f12fb34e9641ca7624029d74c20bbd78c2b108a78b1516587e2abc0ee8a2dd58b23687947f71367b25890b8d6a51f9ebc",
            "public_key_id": "bXBurQuGrvUShPbtZqiYooCt5VsnxpuD6M",
            "tags": [
              "cryptocurrency",
              "freedom",
              "health",
              "survival",
              "truth"

            ],
            "thumbnail": {
              "url": "https://thumbs.odycdn.com/b5f7471f3564243d15df9d0a8de7e340.jpg"
            },
            "title": "Cahlen",
            "website_url": "https://cahlen.org"
          },
          "value_type": "channel"
        },
        "timestamp": 1656016895,
        "txid": "406d14a55fe25fd03397c943a7b7fddbdfb3e3cf794da798ad927a13e1f0a487",
        "type": "claim",
        "value": {
          "description": "Harm is doing something to someone's body or property without their consent.",
          "source": {
            "hash": "ae2abfbc472d996df47adf7d4b5b139bf5649bba1c1a5128fe7c8c8a9d044f4132c59c45bab2426ec4502a7a436afb40",
            "media_type": "video/mp4",
            "name": "CahlenLee_20220623_DefiningHarm.mp4",
            "sd_hash": "89da68b09b7e8bf465f3e9483fc0bd49f563bb539c1d1c1f29b4598a60bae462370d0e7631da3e2a4d25785598cc0e2e",
            "size": "27322173"
          },
          "stream_type": "video",
          "tags": [
            "law",
            "freedom",
            "truth",
            "philosophy",
            "life"
          ],
          "thumbnail": {
            "url": "https://ipfs.cahlen.org/ipfs/QmTcV1ghDQs7WQ5zMmfuCnwjtYNkBDLoWKdz3bEfQaWtLc"
          },
          "title": "Defining Harm",
          "video": {
            "duration": 209,
            "height": 480,
            "width": 854
          }
        },
        "value_type": "stream"
      },

The claim was the 4th of 20 in the first page.

swdev1@Jonathans-Mac-mini herald % egrep "canonical_url" response.json |wc
      40      80    2594
swdev1@Jonathans-Mac-mini herald % egrep "canonical_url" response.json    
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_OffgridDinner#a",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_JerusalemArtichokes#9",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_ThoughtsonVampires#b",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_DefiningHarm#4",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_ThoughtsonDemocracy#d",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220621_EnergyWeapons#f",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220619_CurrantsforDessert#4",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220619_JudgePeople#6",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220618_MillbankBag#d",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220618_FirstBigRain#e",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220615_ThoughtsontheSoul#3",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220615_SurvivalGearList#c",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220614_ClixmoneyInterviewsCahlen#a",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220614_ClimateChangeSorcery#6",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220613_GardenUpdate-June13th2022#c",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220612_TheyFearGuns#2",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220612_TheyWantYoutoDie#b",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220611_ThoughtsonTrump#f",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220610_SnakeVisit#e",
          "canonical_url": "lbry://@Cahlen#0",
        "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220610_HiveDeepDive#0",
          "canonical_url": "lbry://@Cahlen#0",
I could not reproduce this against the production hubs using production SDK: ``` swdev1@Jonathans-Mac-mini herald % curl -v -X POST -H 'Content-Type: application/json' -d '{"jsonrpc":"2.0","method":"version","params":{}}' localhost:5279 Note: Unnecessary use of -X or --request, POST is already inferred. * Trying 127.0.0.1:5279... * Connected to localhost (127.0.0.1) port 5279 (#0) > POST / HTTP/1.1 > Host: localhost:5279 > User-Agent: curl/7.79.1 > Accept: */* > Content-Type: application/json > Content-Length: 48 > * Mark bundle as not supporting multiuse < HTTP/1.1 200 OK < Content-Type: application/json; charset=utf-8 < Content-Length: 288 < Date: Mon, 15 Aug 2022 16:17:42 GMT < Server: Python/3.7 aiohttp/3.7.4 < { "jsonrpc": "2.0", "result": { "build": "release", "lbrynet_version": "0.107.2", "os_release": "21.5.0", "os_system": "Darwin", "platform": "Darwin-21.5.0-x86_64-i386-64bit", "processor": "i386", "python_version": "3.7.13", "version": "0.107.2" } } ``` The stream was found: ``` curl -v -X POST -H 'Content-Type: application/json' -d '{"jsonrpc":"2.0","method":"claim_search","params":{"page_size":20,"page":1,"claim_type":["stream","repost"],"no_totals":true,"not_tags":[],"order_by":["release_time"],"has_source":true,"fee_amount":">=0","channel_ids":["0739af4338a3e9c2307c4170107b30c0af1e1a1f"],"release_time":"<1656102420","include_purchase_receipt":true},"id":1656102468406}' localhost:5279 { "address": "bKN8Pb8MFvxvJf98S8wTVF1J2DYjMdqCJM", "amount": "1.11", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_DefiningHarm#4", "claim_id": "4bc3518087f23fc0b83e84119bd30f7edb550e39", "claim_op": "create", "confirmations": 28381, "height": 1181280, "is_channel_signature_valid": true, "meta": { "activation_height": 1181280, "creation_height": 1181280, "creation_timestamp": 1656016895, "effective_amount": "1.18941973", "expiration_height": 3283680, "is_controlling": true, "reposted": 1, "support_amount": "0.07941973", "take_over_height": 1181280 }, "name": "CahlenLee_20220623_DefiningHarm", "normalized_name": "cahlenlee_20220623_definingharm", "nout": 0, "permanent_url": "lbry://CahlenLee_20220623_DefiningHarm#4bc3518087f23fc0b83e84119bd30f7edb550e39", "short_url": "lbry://CahlenLee_20220623_DefiningHarm#4", "signing_channel": { "address": "bCmHHBREHNSURY4x2thRARWeQjMyw3nCa7", "amount": "50.0", "canonical_url": "lbry://@Cahlen#0", "claim_id": "0739af4338a3e9c2307c4170107b30c0af1e1a1f", "claim_op": "update", "confirmations": 92369, "has_signing_key": false, "height": 1117292, "meta": { "activation_height": 1117292, "claims_in_channel": 718, "creation_height": 691084, "creation_timestamp": 1577698690, "effective_amount": "1284.957", "expiration_height": 3219692, "is_controlling": true, "reposted": 0, "support_amount": "1234.957", "take_over_height": 691830 }, "name": "@Cahlen", "normalized_name": "@cahlen", "nout": 0, "permanent_url": "lbry://@Cahlen#0739af4338a3e9c2307c4170107b30c0af1e1a1f", "short_url": "lbry://@Cahlen#0", "timestamp": 1645751675, "txid": "e47d3303a96dec612a9f5e245662ea0c0d7be8cbd45659dc16e0a797a0dda4cd", "type": "claim", "value": { "cover": { "url": "https://thumbnails.lbry.com/banner-UCXgiWdSbAapi_Z_RNUur0iA" }, "description": "Modern Day Wizard\nhttps://cahlen.org", "email": "mail@cahlen.org", "locations": [ { "country": "US" } ], "public_key": "3056301006072a8648ce3d020106052b8104000a03420004a5bbee1dac43cccd68681ce1e57b860f12fb34e9641ca7624029d74c20bbd78c2b108a78b1516587e2abc0ee8a2dd58b23687947f71367b25890b8d6a51f9ebc", "public_key_id": "bXBurQuGrvUShPbtZqiYooCt5VsnxpuD6M", "tags": [ "cryptocurrency", "freedom", "health", "survival", "truth" ], "thumbnail": { "url": "https://thumbs.odycdn.com/b5f7471f3564243d15df9d0a8de7e340.jpg" }, "title": "Cahlen", "website_url": "https://cahlen.org" }, "value_type": "channel" }, "timestamp": 1656016895, "txid": "406d14a55fe25fd03397c943a7b7fddbdfb3e3cf794da798ad927a13e1f0a487", "type": "claim", "value": { "description": "Harm is doing something to someone's body or property without their consent.", "source": { "hash": "ae2abfbc472d996df47adf7d4b5b139bf5649bba1c1a5128fe7c8c8a9d044f4132c59c45bab2426ec4502a7a436afb40", "media_type": "video/mp4", "name": "CahlenLee_20220623_DefiningHarm.mp4", "sd_hash": "89da68b09b7e8bf465f3e9483fc0bd49f563bb539c1d1c1f29b4598a60bae462370d0e7631da3e2a4d25785598cc0e2e", "size": "27322173" }, "stream_type": "video", "tags": [ "law", "freedom", "truth", "philosophy", "life" ], "thumbnail": { "url": "https://ipfs.cahlen.org/ipfs/QmTcV1ghDQs7WQ5zMmfuCnwjtYNkBDLoWKdz3bEfQaWtLc" }, "title": "Defining Harm", "video": { "duration": 209, "height": 480, "width": 854 } }, "value_type": "stream" }, ``` The claim was the 4th of 20 in the first page. ``` swdev1@Jonathans-Mac-mini herald % egrep "canonical_url" response.json |wc 40 80 2594 swdev1@Jonathans-Mac-mini herald % egrep "canonical_url" response.json "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_OffgridDinner#a", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_JerusalemArtichokes#9", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220624_ThoughtsonVampires#b", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_DefiningHarm#4", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220623_ThoughtsonDemocracy#d", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220621_EnergyWeapons#f", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220619_CurrantsforDessert#4", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220619_JudgePeople#6", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220618_MillbankBag#d", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220618_FirstBigRain#e", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220615_ThoughtsontheSoul#3", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220615_SurvivalGearList#c", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220614_ClixmoneyInterviewsCahlen#a", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220614_ClimateChangeSorcery#6", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220613_GardenUpdate-June13th2022#c", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220612_TheyFearGuns#2", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220612_TheyWantYoutoDie#b", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220611_ThoughtsonTrump#f", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220610_SnakeVisit#e", "canonical_url": "lbry://@Cahlen#0", "canonical_url": "lbry://@Cahlen#0/CahlenLee_20220610_HiveDeepDive#0", "canonical_url": "lbry://@Cahlen#0", ```
moodyjon commented 2022-08-15 18:29:50 +02:00 (Migrated from github.com)
Copy link

@tzarebczan

Can you confirm this is no longer happening?

@tzarebczan Can you confirm this is no longer happening?
moodyjon commented 2022-08-15 20:43:00 +02:00 (Migrated from github.com)
Copy link

Never mind... This is a real issue that has still been happening recently. See #59 for examples not linked to this channel.

For some reason, this particular channel/claim is no longer an issue.

Never mind... This is a real issue that has still been happening recently. See #59 for examples not linked to this channel. For some reason, this particular channel/claim is no longer an issue.
Sign in to join this conversation.
No Branch/Tag specified
Branches Tags
master
dependabot/pip/aiohttp-3.8.5
dependabot/pip/grpcio-1.53.0
moodyjon/ipv6
ipv6
moodyjon/limited_repost
add-channel-sponsor
es-failover
moodyjon/grpcio_v1.46.0
go-hub
No results found.
Labels
Clear labels   
area: database

   
area: documentation

Improvements or additions to documentation

  
area: elasticsearch

   
area: herald

   
area: packaging

   
area: scribe

   
consider soon

Discuss this issue at the next planning meeting, then remove this label

  
critical

   
dependencies

Pull requests that update a dependency file

  
good first issue

Good for newcomers

  
hacktoberfest

Welcome to Hacktoberfest

  
help wanted

Extra attention is needed

  
improvement

   
needs: repro

Needs a way to reproduce

  
new feature

   
priority: blocker

Issue is blocking release, do ASAP

  
priority: high

Work needs to be moved into sprint ASAP

  
priority: low

Work should be done but can stay in the backlog for now

  
priority: medium

Work needs to be done within 2-3 sprints

  
type: bug

Existing functionality is wrong or broken

  
type: bug-fix

   
type: discussion

A conversation. No specific changes requested

  
type: feature request

   
type: improvement

Existing (or partially existing) functionality needs to be changed

  
type: new feature

New functionality that does not exist yet

  
type: refactor

Minimal user-visible changes, but significant internal work

  
type: task

Either work that's not related to the code, or a small chore that does not fit into other categories

No labels
area: database
area: documentation
area: elasticsearch
area: herald
area: packaging
area: scribe
consider soon
critical
dependencies
good first issue
hacktoberfest
help wanted
improvement
needs: repro
new feature
priority: blocker
priority: high
priority: low
priority: medium
type: bug
type: bug-fix
type: discussion
type: feature request
type: improvement
type: new feature
type: refactor
type: task
Milestone
Clear milestone
No items
No milestone
Projects
Clear projects
No items
No project
Assignees
Clear assignees
No assignees
1 participant
Notifications
Due date
The due date is invalid or out of range. Please use the format "yyyy-mm-dd".

No due date set.

Dependencies

No dependencies set.

Reference: LBRYCommunity/hub#75
No description provided.
Delete branch "%!s()"

Deleting a branch is permanent. Although the deleted branch may continue to exist for a short time before it actually gets removed, it CANNOT be undone in most cases. Continue?