ChainForge/chainforge/oaievals/body-movement.cforge

1 line
27 KiB
Plaintext
Raw Permalink Normal View History

TypeScript backend, HuggingFace models, JavaScript evaluators, Comment Nodes, and more (#81) * Beginning to convert Python backend to Typescript * Change all fetch() calls to fetch_from_backend switcher * wip converting query.py to query.ts * wip started utils.js conversion. Tested that OpenAI API call works * more progress on converting utils.py to Typescript * jest tests for query, utils, template.ts. Confirmed PromptPipeline works. * wip converting queryLLM in flask_app to TS * Tested queryLLM and StorageCache compressed saving/loading * wip execute() in backend.ts * Added execute() and tested w concrete func. Need to test eval() * Added craco for optional webpack config. Config'd for TypeScript with Node.js packages browserify'd * Execute JS code on iframe sandbox * Tested and working JS Evaluator execution. * wip swapping backends * Tested TypeScript backendgit status! :) woot * Added fetchEnvironAPIKeys to Flask server to fetch os.environ keys when running locally * Route Anthropic calls through Flask when running locally * Added info button to Eval nodes. Rebuilt react * Edits to info modal on Eval node * Remove/error out on Python eval nodes when not running locally. * Check browser compat and display error if not supported * Changed all example flows to use JS. Bug fix in query.ts * Refactored to LLMProvider to streamline model additions * Added HuggingFace models API * Added back Dalai call support, routing through Flask * Remove flask app calls and socketio server that are no longer used * Added Comment Nodes. Rebuilt react. * Fix PaLM temp=0 build, update package vers and rebuild react
2023-06-30 15:11:20 -04:00
{"flow": {"nodes": [{"width": 312, "height": 311, "id": "prompt-body-movement", "type": "prompt", "data": {"prompt": "{prompt}", "n": 1, "llms": [{"key": "aa3c0f03-22bd-416e-af4d-4bf5c4278c99", "settings": {"system_msg": "Answer the question based on the following description of a movement. Assume average human body ability.", "temperature": 1, "functions": [], "function_call": "", "top_p": 1, "stop": [], "presence_penalty": 0, "frequency_penalty": 0}, "name": "GPT3.5", "emoji": "\ud83d\ude42", "model": "gpt-3.5-turbo", "base_model": "gpt-3.5-turbo", "temp": 1, "formData": {"shortname": "GPT3.5", "model": "gpt-3.5-turbo", "system_msg": "Answer the question based on the following description of a movement. Assume average human body ability.", "temperature": 1, "functions": "", "function_call": "", "top_p": 1, "stop": "", "presence_penalty": 0, "frequency_penalty": 0}}]}, "position": {"x": 448, "y": 224}, "selected": false, "positionAbsolute": {"x": 448, "y": 224}, "dragging": false}, {"width": 333, "height": 182, "id": "eval-body-movement", "type": "evaluator", "data": {"code": "function evaluate(response) {\n\tlet ideal = response.meta['Ideal'];\n\treturn response.text.startsWith(ideal);\n}", "language": "javascript"}, "position": {"x": 820, "y": 150}, "positionAbsolute": {"x": 820, "y": 150}}, {"width": 228, "height": 196, "id": "vis-body-movement", "type": "vis", "data": {"input": "eval-body-movement"}, "position": {"x": 1200, "y": 250}, "positionAbsolute": {"x": 1200, "y": 250}}, {"width": 302, "height": 260, "id": "inspect-body-movement", "type": "inspect", "data": {"input": "prompt-body-movement"}, "position": {"x": 820, "y": 400}, "positionAbsolute": {"x": 820, "y": 400}}, {"width": 423, "height": 417, "id": "table-body-movement", "type": "table", "data": {"rows": [{"prompt": "\nDescription: A woman is standing on her hands and feet, facing the floor and reaching her hips towards the ceiling, she lifts her left leg towards the ceiling, then lowers it and puts it in between her hands. She inhales and twists her torso pressing her chest against her inner thigh and reaches her arm to the ceiling.\nQuestion: Which arm does she reach up?\nAnswer with a single word: 'left' or 'right'.", "ideal": "left"}, {"prompt": "\nDescription: A man is standing on his left leg, he lifts his other leg and presses it into his chest with both arms. He then grabs the heel of his lifted leg with his hand and stretches it all the way to the side, still holding the heel. He remains upright with her chest opened.\nQuestion: Which hand does he use to hold his leg?\nAnswer with a single word: 'left' or 'right'.", "ideal": "right"}, {"prompt": "\nDescription: A woman is holding a reversed plank position, holding her body in a straight line and facing up. She lifts her left leg off the ground then lifts her hand off the ground and transitions into a side plank.\nQuestion: Which hand does she have to lift off the ground to transition into side plank?\nAnswer with a single word: 'left' or 'right'.", "ideal": "left"}, {"prompt": "\nDescription: A man is in a plank position, holding his body in a straight line and facing the floor. Bracing his core, he lifts his left leg off the floor until it is level with his body, then lifts his opposite arm until it is level with his body, then puts them back on the floor. This is one repetition and he does eight such repetitions, starting with his left leg and alternating sides. This is one set. He takes a few seconds to rest then does the same set again, starting with his right leg this time.\nQuestion: Which arm does he lift at the last repetition of the last set?\nAnswer with a single word: 'left' or 'right'.", "ideal": "right"}, {"prompt": "\nDescription: A woman stands straight, she takes a big step back with her left foot, turning toes of that foot out slightly. She lengthens her torso, opening her chest and reaching her side towards her front leg until she can grab her leg with her arm. She reaches the other arm to the sky and holds, lengthening her body and opening her chest more.\nQuestion: Which arm