Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Changing from a plugin to a standalone CLI application #68

Merged
merged 42 commits into from
Jan 23, 2025
Merged

Conversation

jzonthemtn
Copy link
Collaborator

Changing from a plugin to a standalone CLI application.

Signed-off-by: jzonthemtn <[email protected]>
Copy link
Collaborator

@wrigleyDan wrigleyDan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I left comments regarding pipeline names in the scripts.

I tested calculating judgments with Chorus and got a bunch of errors connected to the JSON structure and fields of the UBI events and queries. I did some local changes and fixed the findings but I think it makes sense to look at them together to make sure we make changes in the right place (here vs Chorus vs the specification vs the UBI JS client).

Other findings:

  • Running the query set generator with a querySetSize of 5 resulted in 6 queries in the query set.
  • Running a query set reported a successful run (Query set run complete: ...). However there were no calculated metrics stored.

Let's have a look together.

data/esci/index.sh Show resolved Hide resolved
scripts/create-pipeline.sh Outdated Show resolved Hide resolved
scripts/get-models.sh Outdated Show resolved Hide resolved
scripts/queryset.json Outdated Show resolved Hide resolved
@jzonthemtn
Copy link
Collaborator Author

  • Running the query set generator with a querySetSize of 5 resulted in 6 queries in the query set.

Found and fixed this one.

@jzonthemtn
Copy link
Collaborator Author

  • Running a query set reported a successful run (Query set run complete: ...). However there were no calculated metrics stored.

I got the metrics indexing now. I had that part removed for a bit. (doh)

Copy link
Collaborator

@wrigleyDan wrigleyDan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice work!

I had to make a few changes to the data model and with the last run I only saw judgments of value 0. Might be data related (the calculation is correct, the event data I have is just rubbish), might be something in the code (the calculation should give us something else for the event data). I'll have a closer look in the next review.

Copy link
Collaborator

@wrigleyDan wrigleyDan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One last request, a renaming request. Other than that: My brief test worked. I tested functionally (=does everything compile and run without errors?)

I got all 0s for all judgments (and as a consequence also for the search metrics) but again, that's something that may well be data-specific that has nothing to do with the implementation.

I'd do these test outside of this PR that really is meant to move from plugin to standalone app.

scripts/create-click-model.sh Outdated Show resolved Hide resolved
Copy link
Collaborator

@wrigleyDan wrigleyDan left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jzonthemtn jzonthemtn merged commit af3750c into main Jan 23, 2025
6 checks passed
@jzonthemtn jzonthemtn deleted the standalone branch January 23, 2025 13:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants