https://github.com/shuyib/pal

Using an LLM to answer math word problems common in IRL. Program aided language modeling.
https://github.com/shuyib/pal

gpt35turbo llm llm-agents llm-apps openai-api pal program-aided-language-model streamlit-application text-davinci-003

Last synced: 24 days ago
JSON representation

Using an LLM to answer math word problems common in IRL. Program aided language modeling.

• Host: GitHub
• URL: https://github.com/shuyib/pal
• Owner: Shuyib
• License: apache-2.0
• Created: 2024-01-05T04:55:09.000Z (12 months ago)
• Default Branch: main
• Last Pushed: 2024-03-06T16:43:00.000Z (10 months ago)
• Last Synced: 2024-04-16T03:50:54.328Z (8 months ago)
• Topics: gpt35turbo, llm, llm-agents, llm-apps, openai-api, pal, program-aided-language-model, streamlit-application, text-davinci-003
• Language: Makefile
• Homepage:
• Size: 30.3 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 1
• Metadata Files:
  • Readme: README.html
  • License: LICENSE

Awesome Lists containing this project

README

        


readme

code{white-space: pre-wrap;}

span.smallcaps{font-variant: small-caps;}

div.columns{display: flex; gap: min(4vw, 1.5em);}

div.column{flex: auto; overflow-x: auto;}

div.hanging-indent{margin-left: 1.5em; text-indent: -1.5em;}

ul.task-list{list-style: none;}

ul.task-list li input[type="checkbox"] {

  width: 0.8em;

  margin: 0 0.8em 0.2em -1.6em;

  vertical-align: middle;

}

pre > code.sourceCode { white-space: pre; position: relative; }

pre > code.sourceCode > span { display: inline-block; line-height: 1.25; }

pre > code.sourceCode > span:empty { height: 1.2em; }

.sourceCode { overflow: visible; }

code.sourceCode > span { color: inherit; text-decoration: inherit; }

div.sourceCode { margin: 1em 0; }

pre.sourceCode { margin: 0; }

@media screen {

div.sourceCode { overflow: auto; }

}

@media print {

pre > code.sourceCode { white-space: pre-wrap; }

pre > code.sourceCode > span { text-indent: -5em; padding-left: 5em; }

}

pre.numberSource code

  { counter-reset: source-line 0; }

pre.numberSource code > span

  { position: relative; left: -4em; counter-increment: source-line; }

pre.numberSource code > span > a:first-child::before

  { content: counter(source-line);

    position: relative; left: -1em; text-align: right; vertical-align: baseline;

    border: none; display: inline-block;

    -webkit-touch-callout: none; -webkit-user-select: none;

    -khtml-user-select: none; -moz-user-select: none;

    -ms-user-select: none; user-select: none;

    padding: 0 4px; width: 4em;

    color: #aaaaaa;

  }

pre.numberSource { margin-left: 3em; border-left: 1px solid #aaaaaa;  padding-left: 4px; }

div.sourceCode

  {   }

@media screen {

pre > code.sourceCode > span > a:first-child::before { text-decoration: underline; }

}

code span.al { color: #ff0000; font-weight: bold; } /* Alert */

code span.an { color: #60a0b0; font-weight: bold; font-style: italic; } /* Annotation */

code span.at { color: #7d9029; } /* Attribute */

code span.bn { color: #40a070; } /* BaseN */

code span.bu { color: #008000; } /* BuiltIn */

code span.cf { color: #007020; font-weight: bold; } /* ControlFlow */

code span.ch { color: #4070a0; } /* Char */

code span.cn { color: #880000; } /* Constant */

code span.co { color: #60a0b0; font-style: italic; } /* Comment */

code span.cv { color: #60a0b0; font-weight: bold; font-style: italic; } /* CommentVar */

code span.do { color: #ba2121; font-style: italic; } /* Documentation */

code span.dt { color: #902000; } /* DataType */

code span.dv { color: #40a070; } /* DecVal */

code span.er { color: #ff0000; font-weight: bold; } /* Error */

code span.ex { } /* Extension */

code span.fl { color: #40a070; } /* Float */

code span.fu { color: #06287e; } /* Function */

code span.im { color: #008000; font-weight: bold; } /* Import */

code span.in { color: #60a0b0; font-weight: bold; font-style: italic; } /* Information */

code span.kw { color: #007020; font-weight: bold; } /* Keyword */

code span.op { color: #666666; } /* Operator */

code span.ot { color: #007020; } /* Other */

code span.pp { color: #bc7a00; } /* Preprocessor */

code span.sc { color: #4070a0; } /* SpecialChar */

code span.ss { color: #bb6688; } /* SpecialString */

code span.st { color: #4070a0; } /* String */

code span.va { color: #19177c; } /* Variable */

code span.vs { color: #4070a0; } /* VerbatimString */

code span.wa { color: #60a0b0; font-weight: bold; font-style: italic; } /* Warning */



PAL - Program Aided Language Model (PAL)

Using streamlit, openai ‘text-davinci-003’ and Langchain to create a program aided language model. They are achieve state of the art results on math word problems. This project is a proof of concept to see if we can make an application to help people with their math problems by using a language model to help them understand the problem better.

Use an LLM -> decompose the problem into runnable steps -> run program in PY IDE -> return results to user.

Learn more by reading the paper or visiting the website.


Installation

To install requirements, make a virtual environment and run:

make venv/bin/activate



# activate the virtual environment

source venv/bin/activate



make install


Usage

To run the app, make sure you are in the virtual environment and run:

make run


Contributing

Explain how to contribute to the project.


License

License information.


window.document.addEventListener("DOMContentLoaded", function (event) {

  const toggleBodyColorMode = (bsSheetEl) => {

    const mode = bsSheetEl.getAttribute("data-mode");

    const bodyEl = window.document.querySelector("body");

    if (mode === "dark") {

      bodyEl.classList.add("quarto-dark");

      bodyEl.classList.remove("quarto-light");

    } else {

      bodyEl.classList.add("quarto-light");

      bodyEl.classList.remove("quarto-dark");

    }

  }

  const toggleBodyColorPrimary = () => {

    const bsSheetEl = window.document.querySelector("link#quarto-bootstrap");

    if (bsSheetEl) {

      toggleBodyColorMode(bsSheetEl);

    }

  }

  toggleBodyColorPrimary();  

  const icon = "";

  const anchorJS = new window.AnchorJS();

  anchorJS.options = {

    placement: 'right',

    icon: icon

  };

  anchorJS.add('.anchored');

  const clipboard = new window.ClipboardJS('.code-copy-button', {

    target: function(trigger) {

      return trigger.previousElementSibling;

    }

  });

  clipboard.on('success', function(e) {

    // button target

    const button = e.trigger;

    // don't keep focus

    button.blur();

    // flash "checked"

    button.classList.add('code-copy-button-checked');

    var currentTitle = button.getAttribute("title");

    button.setAttribute("title", "Copied!");

    let tooltip;

    if (window.bootstrap) {

      button.setAttribute("data-bs-toggle", "tooltip");

      button.setAttribute("data-bs-placement", "left");

      button.setAttribute("data-bs-title", "Copied!");

      tooltip = new bootstrap.Tooltip(button, 

        { trigger: "manual", 

          customClass: "code-copy-button-tooltip",

          offset: [0, -8]});

      tooltip.show();    

    }

    setTimeout(function() {

      if (tooltip) {

        tooltip.hide();

        button.removeAttribute("data-bs-title");

        button.removeAttribute("data-bs-toggle");

        button.removeAttribute("data-bs-placement");

      }

      button.setAttribute("title", currentTitle);

      button.classList.remove('code-copy-button-checked');

    }, 1000);

    // clear code selection

    e.clearSelection();

  });

  function tippyHover(el, contentFn) {

    const config = {

      allowHTML: true,

      content: contentFn,

      maxWidth: 500,

      delay: 100,

      arrow: false,

      appendTo: function(el) {

          return el.parentElement;

      },

      interactive: true,

      interactiveBorder: 10,

      theme: 'quarto',

      placement: 'bottom-start'

    };

    window.tippy(el, config); 

  }

  const noterefs = window.document.querySelectorAll('a[role="doc-noteref"]');

  for (var i=0; i<noterefs.length; i++) {

    const ref = noterefs[i];

    tippyHover(ref, function() {

      // use id or data attribute instead here

      let href = ref.getAttribute('data-footnote-href') || ref.getAttribute('href');

      try { href = new URL(href).hash; } catch {}

      const id = href.replace(/^#\/?/, "");

      const note = window.document.getElementById(id);

      return note.innerHTML;

    });

  }

  const findCites = (el) => {

    const parentEl = el.parentElement;

    if (parentEl) {

      const cites = parentEl.dataset.cites;

      if (cites) {

        return {

          el,

          cites: cites.split(' ')

        };

      } else {

        return findCites(el.parentElement)

      }

    } else {

      return undefined;

    }

  };

  var bibliorefs = window.document.querySelectorAll('a[role="doc-biblioref"]');

  for (var i=0; i<bibliorefs.length; i++) {

    const ref = bibliorefs[i];

    const citeInfo = findCites(ref);

    if (citeInfo) {

      tippyHover(citeInfo.el, function() {

        var popup = window.document.createElement('div');

        citeInfo.cites.forEach(function(cite) {

          var citeDiv = window.document.createElement('div');

          citeDiv.classList.add('hanging-indent');

          citeDiv.classList.add('csl-entry');

          var biblioDiv = window.document.getElementById('ref-' + cite);

          if (biblioDiv) {

            citeDiv.innerHTML = biblioDiv.innerHTML;

          }

          popup.appendChild(citeDiv);

        });

        return popup.innerHTML;

      });

    }

  }

});