1 line
7.6 KiB
Plaintext
Raw Permalink Normal View History

TypeScript backend, HuggingFace models, JavaScript evaluators, Comment Nodes, and more (#81) * Beginning to convert Python backend to Typescript * Change all fetch() calls to fetch_from_backend switcher * wip converting query.py to query.ts * wip started utils.js conversion. Tested that OpenAI API call works * more progress on converting utils.py to Typescript * jest tests for query, utils, template.ts. Confirmed PromptPipeline works. * wip converting queryLLM in flask_app to TS * Tested queryLLM and StorageCache compressed saving/loading * wip execute() in backend.ts * Added execute() and tested w concrete func. Need to test eval() * Added craco for optional webpack config. Config'd for TypeScript with Node.js packages browserify'd * Execute JS code on iframe sandbox * Tested and working JS Evaluator execution. * wip swapping backends * Tested TypeScript backendgit status! :) woot * Added fetchEnvironAPIKeys to Flask server to fetch os.environ keys when running locally * Route Anthropic calls through Flask when running locally * Added info button to Eval nodes. Rebuilt react * Edits to info modal on Eval node * Remove/error out on Python eval nodes when not running locally. * Check browser compat and display error if not supported * Changed all example flows to use JS. Bug fix in query.ts * Refactored to LLMProvider to streamline model additions * Added HuggingFace models API * Added back Dalai call support, routing through Flask * Remove flask app calls and socketio server that are no longer used * Added Comment Nodes. Rebuilt react. * Fix PaLM temp=0 build, update package vers and rebuild react
2023-06-30 15:11:20 -04:00
{"flow": {"nodes": [{"width": 312, "height": 311, "id": "prompt-irony", "type": "prompt", "data": {"prompt": "{prompt}", "n": 1, "llms": [{"key": "aa3c0f03-22bd-416e-af4d-4bf5c4278c99", "settings": {"system_msg": "You will be presented with an example of irony. Determine the type of irony. Types of irony:\n1) situational irony\n2) verbal irony\n3) dramatic irony\nAnswer with situational, verbal, or dramatic. Do not explain the answer. Answer with a single word, lower case, no period, no punctuation.", "temperature": 1, "functions": [], "function_call": "", "top_p": 1, "stop": [], "presence_penalty": 0, "frequency_penalty": 0}, "name": "GPT3.5", "emoji": "\ud83d\ude42", "model": "gpt-3.5-turbo", "base_model": "gpt-3.5-turbo", "temp": 1, "formData": {"shortname": "GPT3.5", "model": "gpt-3.5-turbo", "system_msg": "You will be presented with an example of irony. Determine the type of irony. Types of irony:\n1) situational irony\n2) verbal irony\n3) dramatic irony\nAnswer with situational, verbal, or dramatic. Do not explain the answer. Answer with a single word, lower case, no period, no punctuation.", "temperature": 1, "functions": "", "function_call": "", "top_p": 1, "stop": "", "presence_penalty": 0, "frequency_penalty": 0}}]}, "position": {"x": 448, "y": 224}, "selected": false, "positionAbsolute": {"x": 448, "y": 224}, "dragging": false}, {"width": 333, "height": 182, "id": "eval-irony", "type": "evaluator", "data": {"code": "function evaluate(response) {\n\tlet ideal = response.meta['Ideal'];\n\treturn response.text.startsWith(ideal);\n}", "language": "javascript"}, "position": {"x": 820, "y": 150}, "positionAbsolute": {"x": 820, "y": 150}}, {"width": 228, "height": 196, "id": "vis-irony", "type": "vis", "data": {"input": "eval-irony"}, "position": {"x": 1200, "y": 250}, "positionAbsolute": {"x": 1200, "y": 250}}, {"width": 302, "height": 260, "id": "inspect-irony", "type": "inspect", "data": {"input": "prompt-irony"}, "position": {"x": 820, "y": 400}, "positionAbsolute": {"x": 820, "y": 400}}, {"width": 423, "height": 417, "id": "table-irony", "type": "table", "data": {"rows": [{"prompt": "Here's the example:\nProfessor Snape dislikes Harry Potter because of his popularity and fame. However, it was Snape himself that jump-started the boy\u2019s fame.", "ideal": "situational"}, {"prompt": "Here's the example:\nIn the Gift of the Magi the main characters sell their most treasured possessions to buy something for their spouse, only to discover that both gifts are mutually unusable.", "ideal": "situational"}, {"prompt": "Here's the example:\nIn \u201cMessy Room\u201d by Shel Silverstein the speaker goes on about how messy a child\u2019s room is. Then the poet reveals that the messy room's owner is himself.", "ideal": "situational"}, {"prompt": "Here's the example:\nIn The Wizard of Oz Dorothy travels to the Wizard in order to get home, only to discover she had the power to get home all along, while the other characters ask for things they already possess like courage and brains.", "ideal": "situational"}, {"prompt": "Here's the example:\nIn The Story of an Hour by Kate Chopin the main character believes that her husband has died. She starts to imagine what this new freedom will look like. She returns home in an hour and finds him alive and well. This surprises her as well as the reader.", "ideal": "situational"}, {"prompt": "Here's the example:\nIn Great Expectations Pip has a secret benefactor. Neither Pip nor the reader know who it is. The story makes it seem that the benefactor is Miss Havisham. Magwich, the true benefactor, is revealed clashing with the beliefs of both the audience and Pip.", "ideal": "situational"}, {"prompt": "Here's the example:\nA Modest Proposal starts by advocating for the poor children of America. But he gradually implies that healthy children make better eating.", "ideal": "verbal"}, {"prompt": "Here's the example:\nPride and Prejudice opens with, \"It is a truth universally acknowledged, that a single man in possession of a good fortune, must be in want of a wife.\"", "ideal": "verbal"}, {"p