* Add save to local disk/cache button
* Autosave to local filesystem but hide it
* Use imported filename when saving to local disk after import. Ensure no name clashes.
* Remove unneeded dependencies in pip and update package version
* Hide sidebar button and sidebar when hosted on web
* Add copy button to toolbar.
* Debounce text update on prompt node
* Refactored App.tsx and BaseNode to useMemo for many places such as the toolbar
* Mantine React Table was rerendering cells even when hidden. This change ensures that the inner views of Response Inspectors do not display when the inspector is hidden.
* Add buffered before displaying the inner response inspector view, so that the modal immediately pops up
* Update package version
* Add loading spinner overlay to Response Inspector when it hangs on UI reload
* Use Mantine React Table in Response Inspector
* Merge toolbar into Mantine React Table toolbar, to save space
* Disable counting num of matches in search bar, since this is non-trivial now. We might merge later, but the user can use the num of items in the table view as a proxy.
* Adds `StringLookup` table. Change types related to `LLMResponse`s with a `StringOrHash` type, which can be a string or a number.
* Import/export the lookup table when importing/exporting the flow state.
* Update package version
* Add custom widget using datalist to set model not present in dropdown enum list
* Require `LLMProvider` explicitly passed when querying LLMs.
* Finished UI datalist widget for `react-jsonschema-form`. Tested custom model endpoints in settings windows.
* Added o1+ model hack to strip system message, since OpenAI o1+ models do not yet support system messages (and the `developer` command on their API does not currently work...)
* TabularDataNode supports Replace and Extend for AiGen (#312)
* Testing Values
* Fixed typing issue with Models in fromModelId
* TabularDataNode now supports table generation.
modified: src/AiPopover.tsx
Added support for table replacement
and future support for extension.
modified: src/TabularDataNode.tsx
Added the AiPopover button and
functionality for table replacement.
modified: src/backend/ai.ts
Added specific prompts and decoding
for markdown table generation.
new file: src/backend/tableUtils.ts
Seperated the parsing for tables into
a seperate utility file for better
organization and future extensibility.
* Fixed typing issue with Models in fromModelId
* TabularDataNode now supports table generation.
modified: src/AiPopover.tsx
Added support for table replacement
and future support for extension.
modified: src/TabularDataNode.tsx
Added the AiPopover button and
functionality for table replacement.
modified: src/backend/ai.ts
Added specific prompts and decoding
for markdown table generation.
new file: src/backend/tableUtils.ts
Seperated the parsing for tables into
a seperate utility file for better
organization and future extensibility.
Testing Values
* Added Extend Functionality to Table Popover.
modified: src/AiPopover.tsx
Removed unnecessary import.
Changed handleCommandFill to work with
autofillTable function in ai.ts.
modified: src/TabularDataNode.tsx
Removed Skeleton from Popover.
Changed addMultipleRows such that it
now renders the new rows correctly
and removes the blank row.
modified: src/backend/ai.ts
Added autofillTable function and
changed decodeTable so that they
are flexible with both proper and
improper markdown tables.
Added new system message prompt
specific to autofillTable.
Removed unneccessary log statements.
removed: src/backend/utils.ts
Removed change.
* Added "add column" prompt & button in TablePopover
modified: src/AiPopover.tsx
Added handleGenerateColumn so that
a column can be generated given
a prompt.
Added changes to the TablePopover UI
Now extend is diveded into AddRow
and AddColumn sections.
modified: src/TabularDataNode.tsx
Modified addColumns so that its safer.
Added optional pass of rowValue to
support generateColumn.
modified: src/backend/ai.ts
Added generateColumn and it's
corresponding system message.
Cleaned up some comments and added missing commas.
* Generate Columns now considers item-by-item
processing of the rows for generating the
new column values.
modified: src/AiPopover.tsx
Fixed the key issue for onAddColumn.
modified: src/TabularDataNode.tsx
Changed addColumns to filter out
previously added columns.
modified: src/backend/ai.ts
Changed generateColumns to process
item-by-item to generate new columns.
* Fix bugs. Change OpenAI small model for GenAI features to GPT-4o.
* Update package version
* Remove gen diverse outputs switch in genAI for table
---------
Co-authored-by: Kraft-Cheese <114844630+Kraft-Cheese@users.noreply.github.com>
* Add structured outputs support for OpenAI and Ollama
* Extract outputs from tool_calls and refusal in OpenAI API responses
* Add tool use for Anthropic API. Add new Anthropic models.
* Add num_ctx to Ollama API call
* Update package version
* Update function calling example
* feat(bedrock_llama3): added support for Llama3 (#270)
- added also Claude 3 Opus to the list of models
- replaced hardcoded model Id strings with refs to NativeLLM enum
* chore: bump @mirai73/bedrock-fm library (#277)
- the new version adds source code to facilitate debugging
Co-authored-by: ianarawjo <fatso784@gmail.com>
* Adding together.ai support (#280)
---------
Co-authored-by: ianarawjo <fatso784@gmail.com>
* Add Together.ai and update Bedrock models
---------
Co-authored-by: Massimiliano Angelino <angmas@amazon.com>
Co-authored-by: Can Bal <canbal@users.noreply.github.com>
* Port over and type MultiEvalNode code from the `multi-eval` branch
* Merge css changes from `multi-eval`
* Merge changes to inspector table view from `multi-eval`
* Criteria progress rings
* Debounce renders on text edits
* Add sandbox toggle to Python evals inside MultiEval
* Add uids to evals in MultiEval, for correct cache ids not dependent on name
* <Stack> scores
* Add debounce to editing code or prompts in eval UI
* Update package version
* Refactor: modularize response boxes into a separate component
* Type store.js. Change info to vars. NOTE: This may break backwards compat.
* Refactor addNodes in App.tsx to be simpler.
* Turn AlertModal into a Provider with useContext
* Remove fetch_from_backend.
* Add build/ to gitignore
* Add support for image models and add Dall-E models.
* Better rate limiting with Bottleneck
* Fix new Chrome bug with file import readers not appearing as arrays; and fix bug with exportCache
* Add ability to add custom right-click context menu items per node
* Convert to/from TF and Items nodes
* Add lazyloader for images
* Add compression to images by default before storing in cache
* Add image compression toggle in Global Settings
* Move Alert Provider to top level of index.js
* Adding support for Amazon Bedrock models (#247)
* Create global setting for GenAI features provider, to support Bedrock (Anthropic) models as an alternative
* Reformats dropdown in PromptNode to use Mantine ContextMenu with a nested menu, to save space.
* Remove build folder from git
* Fix context menu to close on click-off. Refactor context menu array code.
* Ensure context menu is positioned below the Add+ button, like a proper dropdown.
* Toggle context menu off when clicking btn again.
---------
Co-authored-by: Massimiliano Angelino <angmas@amazon.com>
* Add human ratings to inspectors
* Store human labels in cache, not resp objs
* Change rating UI to pull from Zustand store
* Lazy load inspectors
* Update version and rebuild app
Adds pyodide WebWorker to run Python scripts, thanks to idea by Shreya.
* Add sandbox option to Python eval nodes.
* Add new Anthropic models
* Disable guards for Python evals on server
* Fix bug with detecting async func in runOverResponses
---------
Co-authored-by: Shreya Shankar <ss.shankar505@gmail.com>
* Adds a purple GenAI button to Code Evaluator Nodes, to allow easier creation of evaluation functions. (NOTE: This, like the TextFields and Items Nodes GenAI features, is experimental and requires an OpenAI API key to access.)
* Adds a drop-down to LLM evaluators
* Ensures LLM evaluators load cache'd responses on load
* Fixes a bug where right-clicking in pop-up Inspectors would bring up the node context menu.
* Internally, refactors evaluator nodes to have inner components that take care of running evaluations, in preparation for multi-eval and running evals elsewhere
* Remove notification dots
* Add batch uids to response objects.
* Regroup responses by batch ids in inspectors. Add batch ids to resp objs. Update examples.
* Bug fix: clear RF state first before loading a flow
* Add random sample toggle to Tabular Data node
* Make sample UI loc conditional on num cols and fit nicer into whitespace
* Adds 'settings template vars' to parametrize on model settings.
* Typecast settings vars params
* Rebuild app and update version
* Add Stop button
* Replaced QueryTracker stop checks in _prompt_llm in query.ts. Modified _prompt_llm and *gen_responses to take in node id for checking purposes. Added new css class for stopping status.
* Used callback function instead of passing id to the backend, renamed QueryStopper and some of its functions, made custom error
* Added semicolons and one more UserForcedPrematureExit check
* Revise canceler to never clear id, and use unique id Date.now instead
* Make cancel go into call_llm funcs
* Cleanup console logs
* Rebuild app and update package version
---------
Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>
Co-authored-by: Ian Arawjo <fatso784@gmail.com>
* Add basic Ollama support (#208)
* Remove trapFocus warning when no OpenAI key set
* Ensure Ollama is only visible in providers list if running locally.
* Remove Dalai.
* Fix ollama support to include chat models and pass chat history correctly
* Fix bug with debounce on progress bar updates in Prompt/Chat nodes
* Rebuilt app and update package version
---------
Co-authored-by: Laurent Huberdeau <16990250+laurenthuberdeau@users.noreply.github.com>
* Add search bar to Response Inspector
* Added search text highlights using mark tags
* Add filter and case sensitive toggles
* Fixed inspector UI for wide and non-wide formats, to include Find bar
* Escape search string before RegExp. Fix longstanding refresh issue when template var is removed.
* Fix styling inconsistency w border width when displaying LLM responses on Firefox
---------
Co-authored-by: Kayla Zethelyn <kaylazethelyn@college.harvard.edu>
