mirror of
https://github.com/ianarawjo/ChainForge.git
synced 2025-03-14 16:26:45 +00:00
b33397930b
* Beginning to convert Python backend to Typescript * Change all fetch() calls to fetch_from_backend switcher * wip converting query.py to query.ts * wip started utils.js conversion. Tested that OpenAI API call works * more progress on converting utils.py to Typescript * jest tests for query, utils, template.ts. Confirmed PromptPipeline works. * wip converting queryLLM in flask_app to TS * Tested queryLLM and StorageCache compressed saving/loading * wip execute() in backend.ts * Added execute() and tested w concrete func. Need to test eval() * Added craco for optional webpack config. Config'd for TypeScript with Node.js packages browserify'd * Execute JS code on iframe sandbox * Tested and working JS Evaluator execution. * wip swapping backends * Tested TypeScript backendgit status! :) woot * Added fetchEnvironAPIKeys to Flask server to fetch os.environ keys when running locally * Route Anthropic calls through Flask when running locally * Added info button to Eval nodes. Rebuilt react * Edits to info modal on Eval node * Remove/error out on Python eval nodes when not running locally. * Check browser compat and display error if not supported * Changed all example flows to use JS. Bug fix in query.ts * Refactored to LLMProvider to streamline model additions * Added HuggingFace models API * Added back Dalai call support, routing through Flask * Remove flask app calls and socketio server that are no longer used * Added Comment Nodes. Rebuilt react. * Fix PaLM temp=0 build, update package vers and rebuild react
1 line
27 KiB
Plaintext
1 line
27 KiB
Plaintext
{"flow": {"nodes": [{"width": 312, "height": 311, "id": "prompt-solve-for-variable", "type": "prompt", "data": {"prompt": "{prompt}", "n": 1, "llms": [{"key": "aa3c0f03-22bd-416e-af4d-4bf5c4278c99", "settings": {"system_msg": "You are expected to reply to a multiple-choice question. In your response, your final answer as the option number should be enclosed in curly brackets like so: {number}. An option number enclosed in curly brackets should appear only once in your response, as this is the one answer you will be evaluated on.", "temperature": 1, "functions": [], "function_call": "", "top_p": 1, "stop": [], "presence_penalty": 0, "frequency_penalty": 0}, "name": "GPT3.5", "emoji": "\ud83d\ude42", "model": "gpt-3.5-turbo", "base_model": "gpt-3.5-turbo", "temp": 1, "formData": {"shortname": "GPT3.5", "model": "gpt-3.5-turbo", "system_msg": "You are expected to reply to a multiple-choice question. In your response, your final answer as the option number should be enclosed in curly brackets like so: {number}. An option number enclosed in curly brackets should appear only once in your response, as this is the one answer you will be evaluated on.", "temperature": 1, "functions": "", "function_call": "", "top_p": 1, "stop": "", "presence_penalty": 0, "frequency_penalty": 0}}]}, "position": {"x": 448, "y": 224}, "selected": false, "positionAbsolute": {"x": 448, "y": 224}, "dragging": false}, {"width": 333, "height": 182, "id": "eval-solve-for-variable", "type": "evaluator", "data": {"code": "function evaluate(response) {\n\tlet ideal = response.meta['Ideal'];\n\treturn response.text.includes(ideal);\n}", "language": "javascript"}, "position": {"x": 820, "y": 150}, "positionAbsolute": {"x": 820, "y": 150}}, {"width": 228, "height": 196, "id": "vis-solve-for-variable", "type": "vis", "data": {"input": "eval-solve-for-variable"}, "position": {"x": 1200, "y": 250}, "positionAbsolute": {"x": 1200, "y": 250}}, {"width": 302, "height": 260, "id": "inspect-solve-for-variable", "type": "inspect", "data": {"input": "prompt-solve-for-variable"}, "position": {"x": 820, "y": 400}, "positionAbsolute": {"x": 820, "y": 400}}, {"width": 423, "height": 417, "id": "table-solve-for-variable", "type": "table", "data": {"rows": [{"prompt": "If\n v = n * (-(12 + h) / 30) * k - 9\nthen which of the following is true?\n 1: n = (v + 9) / ((-(12 + h) / 30) * k)\n 2: n = (v - 9) / ((-(12 + h) / 30) * k)\n 3: n = (v - 9) * (-(12 + h) / 30) * k\n", "ideal": "{1}"}, {"prompt": "If\n p = 9 + 23 - (5 - (21 + 15 / (r * z)) + w + 32) / 31\nthen which of the following is true?\n 1: z = 15 * (5 - ((23 + p + 9) * 31 - 32 - w) + 21) * r\n 2: z = 15 * (5 + (23 + p + 9) / 31 + 32 + w + 21) * r\n 3: z = (15 / (5 - ((23 - (p - 9)) * 31 - 32 - w) - 21)) / r\n 4: z = (15 / (5 - ((23 + p - 9) / 31 + 32 - w) + 21)) * r\n", "ideal": "{3}"}, {"prompt": "If\n z = d * (u + (-39 / e) / 13 + 23)\nthen which of the following is true?\n 1: u = z * d - ((-39 / e) / 13 + 23)\n 2: u = z / d + (-39 / e) / 13 + 23\n 3: u = z / d - ((-39 / e) / 13 + 23)\n 4: u = z * d + (-39 / e) / 13 + 23\n", "ideal": "{3}"}, {"prompt": "If\n t = 4 + 36 - (21 / -m - 38 - 3)\nthen which of the following is true?\n 1: m = 21 * (36 + t + 4 - 3 + 38)\n 2: m = 21 * (36 - (t - 4) - 3 + 38)\n 3: m = -21 / (36 - (t - 4) + 3 + 38)\n 4: m = 21 * (36 + t + 4 - 3 - 38)\n", "ideal": "{3}"}, {"prompt": "If\n g = s - m\nthen which of the following is true?\n 1: s = g + m\n 2: s = g - m\n", "ideal": "{1}"}, {"prompt": "If\n y = 4 * (n - -e / 22) * 12 - d\nthen which of the following is true?\n 1: e = (n + (y + d) * 4 / 12) * 22\n 2: e = (n + (y - d) * 4 * 12) / 22\n 3: e = (((y + d) / 4) / 12 - n) * 22\n 4: e = (n + (y + d) * 4 * 12) * 22\n", "ideal": "{3}"}, {"prompt": "If\n q = -(27 + 4 - (20 - 5 / ((38 - (y + u)) * 22 / f)))\nthen which of the following is true?\n 1: f = (38 - (y + u)) * 22 / (5 * (20 + 4 - (27 - q)))\n 2: f = (38 - (y + u)) * 22 / (5 * (20 + 4 + q + 27))\n 3: f = (38 - (y + u)) * 22 / (5 * (20 + 4 + 27 - q))\n 4: f = (38 - (y + u)) * 22 / (5 / (20 - (4 + q + 27)))\n", "ideal": "{4}"}, {"prompt": "If\n p = (t + z) / d\nthen which of the following is true?\n 1: d = (t + z) / p\n 2: d = (t + z) * p\n", "ideal": "{1}"}, {"prompt": "If\n e = 3 - (x - (g + a - 10)) - 8\nthen which of the following is true?\n 1: a = x + 3 - (e + 8) - 10 + g\n 2: a = x - (3 - (e + 8)) + 10 - g\n 3: a = x + 3 + e - 8 + 10 + g\n", "ideal": "{2}"}, {"prompt": "If\n r = 29 - (17 + (w * k * 21 - p) * 4 + 15)\nthen which of the following is true?\n 1: p = w * k * 21 - (29 - r + 15 - 17) * 4\n 2: p = w * k * 21 - (29 - r - 15 - 17) / 4\n 3: p = w * k * 21 + (29 + r + 15 + 17) * 4\n 4: p = w * k * 21 + (29 + r - 15 + 17) / 4\n", "ideal": "{2}"}, {"prompt": "If\n h = -(27 + 31 + r + c)\nthen which of the following is true?\n 1: c = h - (27 + 31 + r)\n 2: c = h + 27 + 31 + r\n 3: c = -(h + 27 + 31 + r)\n", "ideal": "{3}"}, {"prompt": "If\n e = a - s\nthen which of the following is true?\n 1: a = e + s\n 2: a = e - s\n", "ideal": "{1}"}, {"prompt": "If\n m = 29 * -g * 17 - 2 - p + k\nthen which of the following is true?\n 1: g = (2 - (m - k - p)) * 29 / 17\n 2: g = -(m + k - p + 2) * 29 / 17\n 3: g = (2 - (m - k + p)) * 29 * 17\n 4: g = (-(m - k + p + 2) / 29) / 17\n", "ideal": "{4}"}, {"prompt": "If\n c = -s / u\nthen which of the following is true?\n 1: u = -s * c\n 2: u = -s / c\n", "ideal": "{2}"}, {"prompt": "If\n k = 37 / (c - v - 11)\nthen which of the following is true?\n 1: v = c - (37 / k + 11)\n 2: v = c + 37 / k - 11\n 3: v = c + 37 * k - 11\n", "ideal": "{1}"}, {"prompt": "If\n x = -(p + z - 36 + 17)\nthen which of the following is true?\n 1: p = x + 17 - 36 - z\n 2: p = 36 - (x + 17) - z\n 3: p = x + 17 - 36 + z\n", "ideal": "{2}"}, {"prompt": "If\n e = 12 * 4 * (16 / (11 - x / (r - k))) * 9\nthen which of the following is true?\n 1: k = r - x / (11 + 16 / ((e / 12) * 4 * 9))\n 2: k = r + x * (11 - 16 * (e * 12 / 4) * 9)\n 3: k = r - x / (11 - 16 / (((e / 12) / 4) / 9))\n 4: k = r + x / (11 - 16 * (e * 12 / 4) * 9)\n", "ideal": "{3}"}, {"prompt": "If\n b = -(11 + -p * s)\nthen which of the following is true?\n 1: s = (11 - b) * -p\n 2: s = -(b + 11) / -p\n 3: s = -(b + 11) * -p\n 4: s = (b + 11) * -p\n", "ideal": "{2}"}, {"prompt": "If\n k = (36 - -v / 15) * 31\nthen which of the following is true?\n 1: v = (k / 31 - 36) * 15\n 2: v = (36 + k / 31) * 15\n 3: v = (36 - k * 31) / 15\n 4: v = (36 - k * 31) * 15\n", "ideal": "{1}"}, {"prompt": "If\n y = 15 - 12 / (f / -u)\nthen which of the following is true?\n 1: u = -f * 12 * (15 + y)\n 2: u = f * 12 * (15 + y)\n 3: u = -f / (12 / (15 - y))\n", "ideal": "{3}"}, {"prompt": "If\n c = 10 + 31 - t - 21 + a - 29\nthen which of the following is true?\n 1: a = c + 29 - (10 + 31 - t - 21)\n 2: a = c - 29 - (10 + 31 - t - 21)\n 3: a = c - 29 + 10 + 31 - t - 21\n", "ideal": "{1}"}, {"prompt": "If\n b = (q / -e) * f\nthen which of the following is true?\n 1: f = b * (q / -e)\n 2: f = b / (q / -e)\n", "ideal": "{2}"}, {"prompt": "If\n y = (9 + -e * 22) * m\nthen which of the following is true?\n 1: m = y / (9 + -e * 22)\n 2: m = y * (9 + -e * 22)\n", "ideal": "{1}"}, {"prompt": "If\n t = (-x / s + 34) * k / 27\nthen which of the following is true?\n 1: s = -x * ((t / 27) / k - 34)\n 2: s = -x * ((t / 27) / k + 34)\n 3: s = -x / (t * 27 / k - 34)\n 4: s = -x / ((t / 27) * k + 34)\n", "ideal": "{3}"}, {"prompt": "If\n x = 37 / (33 * (s - (a + 17 + 39)) - g) - 25\nthen which of the following is true?\n 1: s = (37 * (x - 25) - g) * 33 - (a + 17 + 39)\n 2: s = (37 * (x - 25) + g) * 33 + a + 17 + 39\n 3: s = (37 / (x + 25) + g) / 33 + a + 17 + 39\n 4: s = (37 / (x + 25) - g) * 33 - (a + 17 + 39)\n", "ideal": "{3}"}, {"prompt": "If\n n = ((24 - (p - (32 + 28 / (b / f) - 31))) / 2) * 15\nthen which of the following is true?\n 1: b = (28 / (p - (24 - (n / 15) * 2) - 32 + 31)) * f\n 2: b = (28 / (p + 24 + (n / 15) * 2 - 32 - 31)) / f\n 3: b = (28 / (p - (24 + (n / 15) / 2) + 32 - 31)) / f\n 4: b = (28 / (p + 24 - n * 15 * 2 - 32 - 31)) / f\n", "ideal": "{1}"}, {"prompt": "If\n n = 21 - (25 + a / (c / z))\nthen which of the following is true?\n 1: z = c * a * (21 - n + 25)\n 2: z = c * a * (21 + n + 25)\n 3: z = c / (a * (21 + n + 25))\n 4: z = c / (a / (21 - n - 25))\n", "ideal": "{4}"}, {"prompt": "If\n m = 18 * (6 + 13 - (9 + c / (v + t)) + 29 - 32) + 25\nthen which of the following is true?\n 1: c = (13 - ((m - 25) / 18 + 32 - 6 - 29) - 9) * (v + t)\n 2: c = (13 + (m + 25) * 18 - 32 + 6 + 29 + 9) * (v + t)\n 3: c = (13 + (m - 25) * 18 + 32 + 6 + 29 + 9) * (v + t)\n 4: c = (13 + (m + 25) * 18 + 32 + 6 - 29 + 9) / (v + t)\n", "ideal": "{1}"}, {"prompt": "If\n f = 21 * (t / (r / x)) - 36 + 18\nthen which of the following is true?\n 1: t = ((f - 18 + 36) / 21) * (r / x)\n 2: t = (f - 18 - 36) * 21 / (r / x)\n 3: t = (f + 18 - 36) * 21 * (r / x)\n 4: t = (f - 18 - 36) * 21 * (r / x)\n", "ideal": "{1}"}, {"prompt": "If\n a = -19 / (y * v * 24) + 13 - 25\nthen which of the following is true?\n 1: v = ((-19 / (a + 25 - 13)) / 24) / y\n 2: v = -19 * (a - 25 + 13) * 24 * y\n 3: v = -19 * (a - 25 - 13) * 24 * y\n 4: v = (-19 * (a - 25 + 13) / 24) / y\n", "ideal": "{1}"}, {"prompt": "If\n h = a * 36 - m\nthen which of the following is true?\n 1: a = (h + m) * 36\n 2: a = (h - m) * 36\n 3: a = (h - m) / 36\n 4: a = (h + m) / 36\n", "ideal": "{4}"}, {"prompt": "If\n z = (w / ((g + 18) / 6)) / 16\nthen which of the following is true?\n 1: g = (w / (z * 16)) * 6 - 18\n 2: g = w * (z / 16) / 6 - 18\n 3: g = w * (z / 16) / 6 + 18\n", "ideal": "{1}"}, {"prompt": "If\n g = -h * (15 + 38 / (33 / d) + 14)\nthen which of the following is true?\n 1: h = -g / (15 + 38 / (33 / d) + 14)\n 2: h = g * (15 + 38 / (33 / d) + 14)\n 3: h = g / (15 + 38 / (33 / d) + 14)\n", "ideal": "{1}"}, {"prompt": "If\n h = 6 + (d / 13) * 19 - r + t\nthen which of the following is true?\n 1: r = (d / 13) * 19 - (h - 6 - t)\n 2: r = (d / 13) * 19 - (h - 6 + t)\n 3: r = (d / 13) * 19 + h + 6 + t\n", "ideal": "{1}"}, {"prompt": "If\n s = -(-d / (c + n) + 34) * 18 / 10\nthen which of the following is true?\n 1: c = -d * ((s / 10) * 18 - 34) + n\n 2: c = -d * (-s * 10 * 18 - 34) + n\n 3: c = -d * ((-s / 10) * 18 + 34) - n\n 4: c = -d / (-s * 10 / 18 - 34) - n\n", "ideal": "{4}"}, {"prompt": "If\n r = (-38 / ((m + 24 * (z - h)) * 18)) / 6\nthen which of the following is true?\n 1: h = z + (-38 * (r / 6) * 18 + m) * 24\n 2: h = z + (-38 * r * 6 / 18 - m) * 24\n 3: h = z - ((-38 / (r * 6)) / 18 - m) / 24\n", "ideal": "{3}"}, {"prompt": "If\n c = 27 + 38 / ((35 + f - 10 * (x - 19 + a)) * 23 * 29)\nthen which of the following is true?\n 1: x = (f - (((38 / (c - 27)) / 29) / 23 - 35)) / 10 - a + 19\n 2: x = (f + 38 * (c + 27) * 29 * 23 + 35) * 10 + a + 19\n 3: x = (f + 38 * (c + 27) * 29 * 23 + 35) / 10 - a + 19\n", "ideal": "{1}"}, {"prompt": "If\n u = 26 * (30 / -(p + 19 * y + r)) - 11\nthen which of the following is true?\n 1: p = -30 / ((u + 11) / 26) - r - 19 * y\n 2: p = 30 * (u - 11) * 26 + r + 19 * y\n 3: p = -30 * ((u - 11) / 26) + r - 19 * y\n", "ideal": "{1}"}, {"prompt": "If\n r = -8 * c * n / 24\nthen which of the following is true?\n 1: c = r * 24 * -8 / n\n 2: c = (r / 24) * -8 * n\n 3: c = (r * 24 / -8) / n\n", "ideal": "{3}"}, {"prompt": "If\n c = g * 23\nthen which of the following is true?\n 1: g = c * 23\n 2: g = c / 23\n", "ideal": "{2}"}, {"prompt": "If\n e = -(28 + y * (a * (17 - -n / 6) / 30))\nthen which of the following is true?\n 1: n = ((e - 28) * y * 30 * a - 17) / 6\n 2: n = (17 - ((e - 28) * y / 30) * a) / 6\n 3: n = ((-(e + 28) / y) * 30 / a - 17) * 6\n 4: n = -(17 + ((28 - e) * y / 30) * a) / 6\n", "ideal": "{3}"}, {"prompt": "If\n t = 13 + 29 - (20 - (x * (30 - s) * 6 + 39) / h) / 10\nthen which of the following is true?\n 1: x = ((20 + (29 + t + 13) / 10) / h + 39) * 6 * (30 - s)\n 2: x = ((20 + (29 + t + 13) / 10) * h + 39) * 6 * (30 - s)\n 3: x = (((20 + (29 + t + 13) * 10) / h - 39) / 6) * (30 - s)\n 4: x = (((20 - (29 - (t - 13)) * 10) * h - 39) / 6) / (30 - s)\n", "ideal": "{4}"}, {"prompt": "If\n g = -x * h - 10 + n\nthen which of the following is true?\n 1: n = g + -x * h - 10\n 2: n = g - (-x * h - 10)\n", "ideal": "{2}"}, {"prompt": "If\n d = c / f\nthen which of the following is true?\n 1: f = c * d\n 2: f = c / d\n", "ideal": "{2}"}, {"prompt": "If\n f = 34 / (((4 + w - d) / h) * 22)\nthen which of the following is true?\n 1: w = ((34 / f) / 22) * h + d - 4\n 2: w = (34 * f / 22) / h + d - 4\n 3: w = (34 / f) * 22 / h - d + 4\n 4: w = 34 * f * 22 / h + d + 4\n", "ideal": "{1}"}, {"prompt": "If\n u = a * (((9 - -n / 11) * 19 - 31) / z)\nthen which of the following is true?\n 1: z = ((9 - -n / 11) * 19 - 31) * u * a\n 2: z = ((9 - -n / 11) * 19 - 31) / (u / a)\n 3: z = ((9 - -n / 11) * 19 - 31) / (u * a)\n 4: z = ((9 - -n / 11) * 19 - 31) * (u / a)\n", "ideal": "{2}"}, {"prompt": "If\n a = 18 - (10 * ((m / u) * d - 24) - 38) / 26\nthen which of the following is true?\n 1: u = m * ((((18 + a) * 26 - 38) * 10 - 24) / d)\n 2: u = m * (((18 - a) * 26 + 38) * 10 - 24) * d\n 3: u = m * ((((18 + a) / 26 - 38) * 10 - 24) / d)\n 4: u = m / ((((18 - a) * 26 + 38) / 10 + 24) / d)\n", "ideal": "{4}"}, {"prompt": "If\n u = e + w - 13\nthen which of the following is true?\n 1: w = u - 13 + e\n 2: w = u - 13 - e\n 3: w = u + 13 + e\n 4: w = u + 13 - e\n", "ideal": "{4}"}, {"prompt": "If\n g = -a\nthen which of the following is true?\n 1: a = -g\n 2: a = g\n", "ideal": "{1}"}, {"prompt": "If\n q = 20 + f - t\nthen which of the following is true?\n 1: t = 20 + f - q\n 2: t = 20 + f + q\n", "ideal": "{1}"}, {"prompt": "If\n a = 11 + q - 17 / (b - (29 - (30 - h)) - 9)\nthen which of the following is true?\n 1: q = a - 11 + 17 / (b - (29 - (30 - h)) - 9)\n 2: q = a + 11 - 17 / (b - (29 - (30 - h)) - 9)\n 3: q = a - 11 - 17 / (b - (29 - (30 - h)) - 9)\n 4: q = a + 11 + 17 / (b - (29 - (30 - h)) - 9)\n", "ideal": "{1}"}, {"prompt": "If\n v = 31 + (21 * (w / (26 * 6 * a * 7)) / f) * 3 + 33\nthen which of the following is true?\n 1: a = (((w / (((v - 33 - 31) / 3) * f / 21)) / 26) / 6) / 7\n 2: a = (w * ((v + 33 - 31) * 3 / f) * 21 * 26 / 6) * 7\n 3: a = (((w / (((v - 33 + 31) * 3 / f) / 21)) / 26) / 6) * 7\n 4: a = (w / (((v + 33 + 31) * 3 / f) / 21)) * 26 * 6 * 7\n", "ideal": "{1}"}, {"prompt": "If\n c = 4 + d - s - n\nthen which of the following is true?\n 1: s = 4 + d + c + n\n 2: s = 4 + d - (c + n)\n 3: s = 4 + d + c - n\n", "ideal": "{2}"}, {"prompt": "If\n f = b * 4\nthen which of the following is true?\n 1: b = f / 4\n 2: b = f * 4\n", "ideal": "{1}"}, {"prompt": "If\n d = 29 / (14 * (35 - 11 * -(c * (v + f) + 23) * 39))\nthen which of the following is true?\n 1: c = ((35 - 29 * d * 14) * 11 * 39 + 23) / (v + f)\n 2: c = ((((29 / d) / 14 - 35) / 11) / 39 - 23) / (v + f)\n 3: c = ((35 + (29 / d) * 14) * 11 * 39 + 23) / (v + f)\n 4: c = (-(35 + 29 * d * 14) * 11 * 39 + 23) * (v + f)\n", "ideal": "{2}"}, {"prompt": "If\n t = 3 - ((w / (15 * e - 18 + v)) / 38) / 19\nthen which of the following is true?\n 1: v = w * ((3 + t) / 19) * 38 + 15 * e - 18\n 2: v = w * (((3 + t) / 19) / 38) + 15 * e - 18\n 3: v = w / ((3 - t) * 19 * 38) - (15 * e - 18)\n 4: v = w * (3 + t) * 19 * 38 - (15 * e - 18)\n", "ideal": "{3}"}, {"prompt": "If\n t = (-33 / (2 + v - u * -q)) * 7 / 13\nthen which of the following is true?\n 1: u = (v + -33 / (t * 13 * 7) + 2) / -q\n 2: u = (v + -33 * (t / 13) * 7 + 2) * -q\n 3: u = (v - (-33 / ((t / 13) * 7) + 2)) * -q\n 4: u = (v - (-33 / (t * 13 / 7) - 2)) / -q\n", "ideal": "{4}"}, {"prompt": "If\n m = 23 + (k / (12 * (u / d)) + 17) / 4\nthen which of the following is true?\n 1: d = u * ((k / ((m + 23) / 4 + 17)) / 12)\n 2: d = u / (k * ((m - 23) * 4 + 17) * 12)\n 3: d = u / ((k / ((m - 23) * 4 - 17)) / 12)\n 4: d = u / ((k / ((m + 23) * 4 + 17)) * 12)\n", "ideal": "{3}"}, {"prompt": "If\n b = -y\nthen which of the following is true?\n 1: y = -b\n 2: y = b\n", "ideal": "{1}"}, {"prompt": "If\n z = 6 - (27 - (13 + (v / (k + t)) * 19))\nthen which of the following is true?\n 1: v = ((27 - (6 + z) + 13) / 19) * (k + t)\n 2: v = ((27 - (6 - z) + 13) / 19) / (k + t)\n 3: v = ((27 - (6 - z) - 13) / 19) * (k + t)\n 4: v = (27 + 6 - z - 13) * 19 * (k + t)\n", "ideal": "{3}"}, {"prompt": "If\n d = 26 - (w - (14 / (-q * n)) / 35) / 22\nthen which of the following is true?\n 1: q = (-14 / ((w - (26 - d) * 22) * 35)) / n\n 2: q = 14 * (w + (26 + d) / 22) * 35 * n\n 3: q = 14 * (w - (26 - d) * 22) * 35 * n\n 4: q = -14 * ((w + (26 + d) / 22) / 35) * n\n", "ideal": "{1}"}, {"prompt": "If\n e = q * 15 * k * 27 - h\nthen which of the following is true?\n 1: q = (((e + h) / 27) / k) / 15\n 2: q = (e + h) * 27 * k * 15\n 3: q = ((e - h) * 27 / k) / 15\n 4: q = (e + h) * 27 * k / 15\n", "ideal": "{1}"}, {"prompt": "If\n t = (18 - (q - u)) * 11 / 33\nthen which of the following is true?\n 1: q = 18 - t * 33 / 11 + u\n 2: q = 18 + (t / 33) * 11 - u\n 3: q = 18 + t * 33 * 11 - u\n", "ideal": "{1}"}, {"prompt": "If\n h = -(a / r + 22)\nthen which of the following is true?\n 1: r = a * (h + 22)\n 2: r = a / -(h + 22)\n 3: r = a * (h - 22)\n 4: r = a * -(h + 22)\n", "ideal": "{2}"}, {"prompt": "If\n k = (38 - (18 - (20 + ((h - d) / r) * 32))) / 29\nthen which of the following is true?\n 1: h = ((18 - (38 - k * 29) - 20) / 32) * r + d\n 2: h = (18 + 38 + k / 29 + 20) * 32 / r - d\n 3: h = (18 - (38 + k / 29) + 20) * 32 * r - d\n", "ideal": "{1}"}, {"prompt": "If\n f = -18 / (u + 31)\nthen which of the following is true?\n 1: u = -18 / f - 31\n 2: u = -18 * f - 31\n 3: u = -18 * f + 31\n 4: u = -18 / f + 31\n", "ideal": "{1}"}, {"prompt": "If\n c = 23 / ((21 - ((38 / (k * (h - 15))) / 33) / 19) / n)\nthen which of the following is true?\n 1: n = (21 - ((38 / (k * (h - 15))) / 33) / 19) / (23 * c)\n 2: n = (21 - ((38 / (k * (h - 15))) / 33) / 19) * 23 * c\n 3: n = (21 - ((38 / (k * (h - 15))) / 33) / 19) / (23 / c)\n", "ideal": "{3}"}, {"prompt": "If\n z = 6 - ((17 - (c - (19 - m) * d)) / 23) / 10\nthen which of the following is true?\n 1: d = (c + 17 + ((6 + z) / 10) * 23) / (19 - m)\n 2: d = (c + 17 + (6 - z) * 10 * 23) * (19 - m)\n 3: d = (c - (17 + ((6 - z) / 10) / 23)) * (19 - m)\n 4: d = (c - (17 - (6 - z) * 10 * 23)) / (19 - m)\n", "ideal": "{4}"}, {"prompt": "If\n b = v * x\nthen which of the following is true?\n 1: v = b / x\n 2: v = b * x\n", "ideal": "{1}"}, {"prompt": "If\n m = 35 * 12 * 9 * (-u * 13 - y)\nthen which of the following is true?\n 1: u = (m * 35 * 12 * 9 - y) * 13\n 2: u = -(m * 35 * 12 * 9 + y) / 13\n 3: u = -(((m / 35) / 12) / 9 + y) / 13\n 4: u = (((m / 35) / 12) * 9 - y) / 13\n", "ideal": "{3}"}, {"prompt": "If\n m = (y + 29 + a * 5 / e - 34) * 10\nthen which of the following is true?\n 1: e = a * 5 * (m * 10 + y - 34 + 29)\n 2: e = a * 5 / (m / 10 - y + 34 - 29)\n 3: e = a * 5 * (m * 10 - y - 34 - 29)\n 4: e = a * 5 / (m / 10 + y - 34 - 29)\n", "ideal": "{2}"}, {"prompt": "If\n z = (((36 / (17 * (27 + h + 14 - 13))) / 39) / 15) * 38\nthen which of the following is true?\n 1: h = 36 * z * 38 * 15 * 39 / 17 + 27 + 13 + 14\n 2: h = 36 * (z * 38 * 15 / 39) / 17 + 27 + 13 - 14\n 3: h = (36 / ((z / 38) * 15 * 39)) / 17 - 27 + 13 - 14\n 4: h = 36 * ((z * 38 / 15) / 39) / 17 - 27 - 13 - 14\n", "ideal": "{3}"}, {"prompt": "If\n a = k / -p\nthen which of the following is true?\n 1: p = -k / a\n 2: p = k * a\n 3: p = k / a\n", "ideal": "{1}"}, {"prompt": "If\n s = t * (p + c) / 37\nthen which of the following is true?\n 1: t = s * 37 * (p + c)\n 2: t = s * 37 / (p + c)\n 3: t = (s / 37) * (p + c)\n", "ideal": "{2}"}, {"prompt": "If\n y = -34 * 6 * (w + u - v + 4) + 14\nthen which of the following is true?\n 1: v = u + (y + 14) * -34 * 6 + 4 + w\n 2: v = u + (y + 14) * -34 / 6 + 4 + w\n 3: v = u - (((y - 14) / -34) / 6 - 4 - w)\n 4: v = u + ((y - 14) / -34) * 6 + 4 - w\n", "ideal": "{3}"}, {"prompt": "If\n p = (r - (28 - w * 39 * 36 * -(m + 35))) * 25\nthen which of the following is true?\n 1: r = p * 25 - (28 - w * 39 * 36 * -(m + 35))\n 2: r = p / 25 - (28 - w * 39 * 36 * -(m + 35))\n 3: r = p * 25 + 28 - w * 39 * 36 * -(m + 35)\n 4: r = p / 25 + 28 - w * 39 * 36 * -(m + 35)\n", "ideal": "{4}"}, {"prompt": "If\n e = (22 / (q - 7 * m * d)) * 32\nthen which of the following is true?\n 1: m = ((q + 22 * (e / 32)) / 7) * d\n 2: m = ((q - 22 * (e / 32)) / 7) * d\n 3: m = ((q - 22 / (e / 32)) / 7) / d\n 4: m = (q + 22 * e * 32) * 7 * d\n", "ideal": "{3}"}, {"prompt": "If\n m = 30 - -(-p * 23 + c + 22) * k\nthen which of the following is true?\n 1: p = (c - ((30 + m) * k + 22)) * 23\n 2: p = ((m - 30) * k + 22 - c) / 23\n 3: p = ((30 + m) * k + 22 + c) / 23\n 4: p = (c - ((m - 30) / k - 22)) / 23\n", "ideal": "{4}"}, {"prompt": "If\n h = -(18 + -(v / t - e + 30) / 39 + 27 + 17)\nthen which of the following is true?\n 1: v = ((h + 17 + 27 - 18) / 39 - 30 - e) / t\n 2: v = ((h + 17 + 27 + 18) * 39 - 30 + e) * t\n 3: v = ((h + 17 + 27 + 18) / 39 + 30 - e) * t\n", "ideal": "{2}"}, {"prompt": "If\n s = e / 13 - 16 - 29 + 8\nthen which of the following is true?\n 1: e = (s + 8 - 29 - 16) * 13\n 2: e = (s + 8 + 29 + 16) / 13\n 3: e = (s - 8 - 29 - 16) * 13\n 4: e = (s - 8 + 29 + 16) * 13\n", "ideal": "{4}"}, {"prompt": "If\n p = 24 + (25 - a - r) * f\nthen which of the following is true?\n 1: a = 25 + (p + 24) / f - r\n 2: a = 25 + (p + 24) * f + r\n 3: a = 25 + (p + 24) / f + r\n 4: a = 25 - ((p - 24) / f + r)\n", "ideal": "{4}"}, {"prompt": "If\n y = -c * u\nthen which of the following is true?\n 1: u = y * -c\n 2: u = y / -c\n", "ideal": "{2}"}, {"prompt": "If\n m = 36 + 34 / -k\nthen which of the following is true?\n 1: k = 34 * (m + 36)\n 2: k = 34 / (m - 36)\n 3: k = -34 / (m - 36)\n 4: k = -34 / (m + 36)\n", "ideal": "{3}"}, {"prompt": "If\n a = 20 - (32 - (18 + 19 + -h / (b / n)))\nthen which of the following is true?\n 1: b = (-h / (32 + 20 - a - 18 + 19)) / n\n 2: b = (-h / (32 - (20 - a) - 18 - 19)) * n\n 3: b = -h * (32 + 20 - a + 18 - 19) * n\n 4: b = (-h / (32 - (20 - a) + 18 + 19)) / n\n", "ideal": "{2}"}, {"prompt": "If\n c = 28 + (38 - (f * (35 + t + x) + 7 + 6) + 4) / 36\nthen which of the following is true?\n 1: f = (38 - ((c - 28) / 36 + 4) - 6 - 7) * (35 + t + x)\n 2: f = (38 - ((c - 28) / 36 + 4) - 6 + 7) * (35 + t + x)\n 3: f = (38 + (c + 28) * 36 + 4 + 6 + 7) / (35 + t + x)\n 4: f = (38 - ((c - 28) * 36 - 4) - 6 - 7) / (35 + t + x)\n", "ideal": "{4}"}, {"prompt": "If\n u = (22 - (k + (s / (7 + 26 / v)) * 11 * 38)) / 34\nthen which of the following is true?\n 1: s = (22 + u / 34 + k) * 38 * 11 / (7 + 26 / v)\n 2: s = (((22 + u / 34 - k) / 38) / 11) / (7 + 26 / v)\n 3: s = (((22 - u * 34 - k) / 38) / 11) * (7 + 26 / v)\n 4: s = (((22 + u / 34 + k) / 38) / 11) * (7 + 26 / v)\n", "ideal": "{3}"}, {"prompt": "If\n k = (6 / (g + 7 / (15 + w + 21))) / 20\nthen which of the following is true?\n 1: w = 7 * (6 / (k / 20) + g) + 21 + 15\n 2: w = 7 / (6 * k * 20 + g) + 21 - 15\n 3: w = 7 / (6 / (k * 20) - g) - 21 - 15\n", "ideal": "{3}"}, {"prompt": "If\n t = -(y + 31 - g + 18)\nthen which of the following is true?\n 1: y = 18 - t - (31 - g)\n 2: y = t + 18 + 31 - g\n 3: y = -(t + 18 + 31 - g)\n 4: y = t - 18 - (31 - g)\n", "ideal": "{3}"}, {"prompt": "If\n m = 29 + 5 - g / 39\nthen which of the following is true?\n 1: g = (5 - (m - 29)) / 39\n 2: g = (5 - (m - 29)) * 39\n 3: g = (5 + m + 29) / 39\n 4: g = (5 - (m + 29)) / 39\n", "ideal": "{2}"}, {"prompt": "If\n v = (x * a / r) * 15\nthen which of the following is true?\n 1: r = x * a / (v / 15)\n 2: r = x * a * v * 15\n 3: r = x * a / (v * 15)\n", "ideal": "{1}"}, {"prompt": "If\n e = n / (3 - d / w)\nthen which of the following is true?\n 1: d = (3 + n * e) * w\n 2: d = (3 - n * e) / w\n 3: d = (3 - n / e) * w\n 4: d = (3 + n / e) * w\n", "ideal": "{3}"}, {"prompt": "If\n n = k + p - m\nthen which of the following is true?\n 1: p = n - k - m\n 2: p = n - k + m\n 3: p = n + k - m\n", "ideal": "{2}"}, {"prompt": "If\n m = 32 + -23 / (c / (19 - k * p))\nthen which of the following is true?\n 1: k = (19 + c * -23 * (m + 32)) * p\n 2: k = (19 + c / (-23 * (m - 32))) * p\n 3: k = (19 - c * (-23 / (m + 32))) / p\n 4: k = (19 - c / (-23 / (m - 32))) / p\n", "ideal": "{4}"}, {"prompt": "If\n w = x - -p * 16\nthen which of the following is true?\n 1: x = w + -p * 16\n 2: x = w - -p * 16\n", "ideal": "{1}"}, {"prompt": "If\n w = 27 - (-24 / (h - (9 + 36 / m) - x)) / 26 + 21\nthen which of the following is true?\n 1: x = h - (9 + 36 / m) - -24 / ((27 - (w - 21)) * 26)\n 2: x = h - (9 + 36 / m) + -24 * ((27 + w + 21) / 26)\n 3: x = h - (9 + 36 / m) + -24 * ((27 + w - 21) / 26)\n 4: x = h - (9 + 36 / m) - -24 * ((27 + w + 21) / 26)\n", "ideal": "{1}"}, {"prompt": "If\n k = 26 + 17 * (y + m * -c / 19)\nthen which of the following is true?\n 1: y = (k + 26) * 17 + m * -c / 19\n 2: y = (k + 26) * 17 - m * -c / 19\n 3: y = (k - 26) / 17 - m * -c / 19\n 4: y = (k - 26) * 17 - m * -c / 19\n", "ideal": "{3}"}, {"prompt": "If\n k = a / (h - 12 * p)\nthen which of the following is true?\n 1: p = (h + a / k) / 12\n 2: p = (h + a / k) * 12\n 3: p = (h + a * k) * 12\n 4: p = (h - a / k) / 12\n", "ideal": "{4}"}, {"prompt": "If\n m = 9 - (2 - (b + f - q - 8 + 12)) * 39 + 30\nthen which of the following is true?\n 1: q = f - (2 - (9 + m + 30) * 39 - b - 12 - 8)\n 2: q = f - (2 + (9 + m + 30) * 39 - b + 12 - 8)\n 3: q = f + 2 + (9 - (m - 30)) * 39 + b + 12 + 8\n 4: q = f - (2 - (9 - (m - 30)) / 39 - b - 12 + 8)\n", "ideal": "{4}"}, {"prompt": "If\n s = -((x - m) / 17 + n + 5)\nthen which of the following is true?\n 1: m = x + (s - 5 + n) * 17\n 2: m = x + (5 - s + n) * 17\n 3: m = x - -(s + 5 + n) * 17\n 4: m = x + (s + 5 + n) / 17\n", "ideal": "{3}"}, {"prompt": "If\n b = d * (36 / ((q + 29) * 2))\nthen which of the following is true?\n 1: q = (36 / (b / d)) * 2 + 29\n 2: q = (36 / (b / d)) / 2 - 29\n 3: q = (36 / (b * d)) * 2 - 29\n 4: q = 36 * b * d / 2 - 29\n", "ideal": "{2}"}], "columns": [{"key": "prompt", "header": "Prompt"}, {"key": "ideal", "header": "Ideal"}]}, "position": {"x": -16, "y": 160}, "selected": false, "positionAbsolute": {"x": -16, "y": 160}, "dragging": false}], "edges": [{"source": "prompt-solve-for-variable", "sourceHandle": "prompt", "target": "eval-solve-for-variable", "targetHandle": "responseBatch", "interactionWidth": 100, "markerEnd": {"type": "arrow", "width": "22px", "height": "22px"}, "id": "reactflow__edge-prompt-1686756357355prompt-eval-1686756357355responseBatch"}, {"source": "prompt-solve-for-variable", "sourceHandle": "prompt", "target": "inspect-solve-for-variable", "targetHandle": "input", "interactionWidth": 100, "markerEnd": {"type": "arrow", "width": "22px", "height": "22px"}, "id": "reactflow__edge-prompt-1686756357355prompt-inspect-1686756357355input"}, {"source": "eval-solve-for-variable", "sourceHandle": "output", "target": "vis-solve-for-variable", "targetHandle": "input", "interactionWidth": 100, "markerEnd": {"type": "arrow", "width": "22px", "height": "22px"}, "id": "reactflow__edge-eval-1686756357355output-vis-1686756357355input"}, {"source": "table-solve-for-variable", "sourceHandle": "Prompt", "target": "prompt-solve-for-variable", "targetHandle": "prompt", "interactionWidth": 100, "markerEnd": {"type": "arrow", "width": "22px", "height": "22px"}, "id": "reactflow__edge-table-1686756385002Prompt-prompt-1686756357355prompt"}], "viewport": {"x": 144, "y": 37, "zoom": 1}}, "cache": {"eval-1686756357355.json": {}, "inspect-1686756357355.json": {}, "prompt-1686756357355.json": {}, "table-1686756385002.json": {}, "vis-1686756357355.json": {}}} |