378 Commits

Author SHA1 Message Date
Ian Arawjo
d59d83263e bug fix code on save 2024-03-07 14:35:54 -05:00
Ian Arawjo
488e2d1f22 remove escape braces in eval 2024-03-07 14:27:49 -05:00
Ian Arawjo
3774c0d7b3 Wrap textfields in a ScrollArea that appears only when exceeding max height 2024-03-07 13:59:16 -05:00
Shreya Shankar
201ac18ccf
Refactor Executor code to set eval criteria after init (#239)
* Make evaluation criteria optional in executor constructor
2024-03-06 13:28:44 -05:00
Ian Arawjo
3650481f8d Transfer important pyodide bug fix over to this branch 2024-03-06 13:21:19 -05:00
Ian Arawjo
328718b28b Add new Anthropic models 2024-03-05 21:24:02 -05:00
Ian Arawjo
28151495bf Everything hooked up 2024-03-05 18:47:18 -05:00
Ian Arawjo
a3f77a7667 Connect up executor to grading resp window 2024-03-04 17:27:42 -05:00
Ian Arawjo
5444d379d5 Full draft of criteria gen screen. Onto part 2 2024-03-04 13:49:52 -05:00
Ian Arawjo
2b42b54d9e Hook up criteria gen to front-end 2024-03-03 22:46:40 -05:00
Ian Arawjo
bac42d79d5 Add pyodide worker files and separate code types in EvalCriteria 2024-03-03 21:45:53 -05:00
Ian Arawjo
be0839a448 Add sandbox option to Python eval nodes. Add pyodide WebWorker to run Python scripts.
WIP: Other things are commented out temporarily
2024-03-03 21:30:55 -05:00
Ian Arawjo
fb2cb7b518 Run prettier 2024-03-03 16:18:37 -05:00
Ian Arawjo
70f66d91e9 wip 2024-03-03 16:14:12 -05:00
Ian Arawjo
094e73f352 wip merging Shreya's code into CF funcs 2024-03-03 11:21:55 -05:00
Shreya Shankar
e3aac1fa56
Modules for response grading and assertion selection (#230) 2024-03-03 10:03:49 -05:00
Ian Arawjo
0dbd3da0a9 Rebased and rebuilt 2024-02-28 19:12:34 -05:00
Ian Arawjo
34709a4dd6 Run prettier and eslint, fix issues 2024-02-28 19:00:14 -05:00
Ian Arawjo
53892926dc Transition grade resp modal into a container 2024-02-28 18:56:54 -05:00
Ian Arawjo
127c01126d Refining the grading and pick criteria modals 2024-02-28 18:56:52 -05:00
Ian Arawjo
9d6da7c929 Fix merge errors 2024-02-28 18:56:18 -05:00
Ian Arawjo
661ab88994 wip 2024-02-28 18:56:17 -05:00
Ian Arawjo
bd1af30d46 Styling tweaks 2024-02-28 18:54:27 -05:00
Ian Arawjo
adde22fe10 Add GenAI button to code evaluator nodes 2024-02-28 18:52:17 -05:00
Ian Arawjo
484816fafb Componentize LLM evaluator inner UI and logic 2024-02-28 18:47:34 -05:00
Ian Arawjo
a5ce7c5a0a Add expected format to LLM scorer 2024-02-28 18:43:59 -05:00
Ian Arawjo
a4688e4e25 wip 2024-02-28 18:40:11 -05:00
Ian Arawjo
a752b8b232 Componentized the CodeEvaluator inner UI and run logic 2024-02-28 18:40:10 -05:00
Ian Arawjo
3725e1a330 wip 2024-02-28 18:38:18 -05:00
Ian Arawjo
2bb5b3ef75 Typecast settings vars params 2024-02-28 18:37:51 -05:00
Ian Arawjo
a8e7297179 Adds 'settings template vars' to parametrize on model settings. 2024-02-28 18:37:49 -05:00
Ian Arawjo
ad33ed0eb6 Bug fix: clear RF state first before loading a flow 2024-02-28 18:36:57 -05:00
ianarawjo
0a45383b95
Generate code evaluators (#231)
* Adds a purple GenAI button to Code Evaluator Nodes, to allow easier creation of evaluation functions. (NOTE: This, like the TextFields and Items Nodes GenAI features, is experimental and requires an OpenAI API key to access.)

* Adds a drop-down to LLM evaluators

* Ensures LLM evaluators load cache'd responses on load

* Fixes a bug where right-clicking in pop-up Inspectors would bring up the node context menu.

* Internally, refactors evaluator nodes to have inner components that take care of running evaluations, in preparation for multi-eval and running evals elsewhere
2024-02-27 20:27:41 -05:00
Ian Arawjo
5d666643bd Fix TypeScript type errors 2024-02-24 14:31:36 -05:00
ianarawjo
bd35ecddb2
Add Prettier and ESLint formatting (#227)
* Add and run prettier

* Add eslint and code fixes after formatting (#223)

* chore(formatting): config files and packages

* chore(formatting): package.json

* chore(formatting): applying formatting

changes obtained by applying the previous commit and running `npx prettier -w .`

* chore(formatting): added formatting and linting to react app

* chore(formatting): fixes

* chore(eslint): apply fixes to utils.ts

* rebuild

---------

Co-authored-by: Massimiliano Angelino <angmas@amazon.com>

* Rebuild

---------

Co-authored-by: Massimiliano Angelino <angmas@amazon.com>
add-prettier
2024-02-24 11:32:05 -05:00
ianarawjo
d8d02424e2
Add new OpenAI models. (#225) 2024-02-17 12:35:38 -05:00
Ian Arawjo
625619c0b0 Rebuild app and update package version 2024-02-11 16:25:08 -05:00
Ian Arawjo
cff7a470bc Export metavars to excel 2024-02-11 16:22:55 -05:00
Ian Arawjo
08047d2c55 Bug fix join node 2024-01-22 12:56:34 -05:00
ianarawjo
7e1f43688f
"Small" changes (#213)
* Remove notification dots

* Add batch uids to response objects.

* Regroup responses by batch ids in inspectors. Add batch ids to resp objs. Update examples.

* Bug fix: clear RF state first before loading a flow

* Add random sample toggle to Tabular Data node

* Make sample UI loc conditional on num cols and fit nicer into whitespace

* Adds 'settings template vars' to parametrize on model settings.

* Typecast settings vars params

* Rebuild app and update version
v0.2.9.5
2024-01-19 20:23:24 -05:00
Kayla Z
3d15bc9d17
Add stop button to cancel pending queries (#211)
* Add Stop button

* Replaced QueryTracker stop checks in _prompt_llm in query.ts. Modified _prompt_llm and *gen_responses to take in node id for checking purposes. Added new css class for stopping status.

* Used callback function instead of passing id to the backend, renamed QueryStopper and some of its functions, made custom error

* Added semicolons and one more UserForcedPrematureExit check

* Revise canceler to never clear id, and use unique id Date.now instead

* Make cancel go into call_llm funcs

* Cleanup console logs

* Rebuild app and update package version

---------

Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>
Co-authored-by: Ian Arawjo <fatso784@gmail.com>
2024-01-13 18:22:08 -05:00
Ian Arawjo
83c49ffe0b Update readme to point to docs v0.2.8.9 2024-01-08 18:43:27 -05:00
Ian Arawjo
cca6205b70 Remove guide and install_guide, as they are outdated and repeats of the docs 2024-01-08 18:35:14 -05:00
ianarawjo
b92c03afb2
Replace Dalai with Ollama (#209)
* Add basic Ollama support (#208)

* Remove trapFocus warning when no OpenAI key set

* Ensure Ollama is only visible in providers list if running locally. 

* Remove Dalai.

* Fix ollama support to include chat models and pass chat history correctly

* Fix bug with debounce on progress bar updates in Prompt/Chat nodes

* Rebuilt app and update package version

---------

Co-authored-by: Laurent Huberdeau <16990250+laurenthuberdeau@users.noreply.github.com>
2024-01-08 18:33:13 -05:00
ianarawjo
5acdfc0677
Add Search Bar to Inspectors (#206)
* Add search bar to Response Inspector

* Added search text highlights using mark tags

* Add filter and case sensitive toggles

* Fixed inspector UI for wide and non-wide formats, to include Find bar

* Escape search string before RegExp. Fix longstanding refresh issue when template var is removed.

* Fix styling inconsistency w border width when displaying LLM responses on Firefox

---------

Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>
2024-01-05 22:19:50 -05:00
ianarawjo
48f1314d23
Debounce re-renders in prompt node progress listener (#204)
* Debounce rerenders in prompt node progress listener

* Fix debounce lag in genAI for Items nodes

* Rebuild app and update version
2024-01-02 18:33:39 -05:00
ianarawjo
32c62225d2
Debounce text edit callbacks to optimize performance in TFs and Items nodes (#203) 2024-01-02 15:43:13 -05:00
Ian Arawjo
4a45bd6b75 Fix bug with template vars when generating prompt templates w genAI 2024-01-02 11:12:46 -05:00
Ian Arawjo
965b96e451 Fix bug when creating dirs for custom providers 2024-01-02 10:36:43 -05:00
ianarawjo
0af7bdaedd
Bug fix to visibility on TF nodes (#201)
* removed 'source-code-pro' from code css to fix cursor accuracy in code editor (#199)

Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>

* Refactor duplicate code (#198)

* Refactor common const from JoinNode.js, LLMResponseInspector.js, SplitNode.js and VisNode.js into utils.ts

* unfactor same constant different definition, fixed syntax for multiple imports

---------

Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>

* Bug fix to update visibility on TF fields

* rebuild react and update version

---------

Co-authored-by: Kayla Z <77540029+kamazet@users.noreply.github.com>
Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>
2023-12-29 11:18:21 -05:00