Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/seii-saintway/ipymock
A Tool that Allows You Run PyTest within Jupyter Notebook Cells
https://github.com/seii-saintway/ipymock
ai autogpt autogpt-no-paid-api backend-api chatgpt chatgpt-api chatgpt-free democratize-ai free-autogpt gpt-4 gpt-4-api gpt4 mock open-source-auto-gpt open-source-gpt openai openai-api pytest python reverse-engineering
Last synced: about 1 month ago
JSON representation
A Tool that Allows You Run PyTest within Jupyter Notebook Cells
- Host: GitHub
- URL: https://github.com/seii-saintway/ipymock
- Owner: seii-saintway
- License: apache-2.0
- Created: 2021-03-19T07:02:08.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2024-12-12T02:48:44.000Z (about 1 month ago)
- Last Synced: 2024-12-12T03:26:59.785Z (about 1 month ago)
- Topics: ai, autogpt, autogpt-no-paid-api, backend-api, chatgpt, chatgpt-api, chatgpt-free, democratize-ai, free-autogpt, gpt-4, gpt-4-api, gpt4, mock, open-source-auto-gpt, open-source-gpt, openai, openai-api, pytest, python, reverse-engineering
- Language: Jupyter Notebook
- Homepage: https://seii-saintway.github.io/ipymock/
- Size: 104 KB
- Stars: 5
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Running PyTest in Jupyter Notebooks
> iPyMock uses GPT 3.5 turbo by browser automation and a CoSENT based model to embed English and Chinese.
[](https://discord.gg/8YhXA7TYrC)
[](https://twitter.com/seii_saintway)
## Setup iPyMock
`gmail_address` and `gmail_password` are needed for utilizing chrome automation locally.
`conversation_id` could be found in the url of `chat.openai.com/c/`.
```bash
mkdir -p ~/.config/ipymock
cat << EOF > ~/.config/ipymock/config.json
{
"email": "",
"password": "",
"conversation_id": ""
}
EOF
pip install --upgrade ipymock
```
`access_token` at [openai api session](https://chat.openai.com/api/auth/session) is needed for utilizing a backend api proxy.
```bash
mkdir -p ~/.config/ipymock
cat << EOF > ~/.config/ipymock/config.json
{
"chat_gpt_base_url": "",
"access_token": "",
"conversation_id": ""
}
EOF
pip install --upgrade ipymock
```
## Using the OpenAI Backend API from Browser Side in Jupyter Notebooks
```python
from ipymock.browser import start_conversation
import IPython
def ask(prompt):
for response in start_conversation(prompt):
IPython.display.display(IPython.core.display.Markdown(response))
IPython.display.clear_output(wait=True)
import ipymock.browser
# 1. you could initialize chrome automation locally
ipymock.browser.init(['--headless'])
# 2. or if a proxy is deployed locally
ipymock.browser.common.chat_gpt_base_url = 'http://127.0.0.1:8080'
# 3. otherwise using a third party proxy
ipymock.browser.common.chat_gpt_base_url = 'https://.../api'
# the conversation_id which is set in config.json
print(ipymock.browser.common.conversation_id)
ask('''
what is the meaning of getting patched?
''')
```
## Testing AutoGPT
This is the test function for AutoGPT.
```python
import os, sys
os.chdir(os.path.expanduser('~/Auto-GPT'))
sys.path.append(os.path.expanduser('~/Auto-GPT'))
def test_auto_gpt(
mock_openai,
mock_openai_embed,
reset_embed_dimension,
):
from autogpt.main import run_auto_gpt
run_auto_gpt(
continuous = True,
continuous_limit = 10000,
ai_settings = None,
skip_reprompt = False,
speak = True,
debug = False,
gpt3only = False,
gpt4only = True,
memory_type = 'local',
browser_name = 'safari',
allow_downloads = True,
skip_news = True,
workspace_directory = os.path.expanduser('~/Auto-GPT/andrew_space'),
install_plugin_deps = True,
)
assert True
```
It actually run AutoGPT by pytest mock and browser automation.
```python
import ipymock
import ipymock.browser
import ipymock.llm
import pytest
# reset conversation_id to empty to start a new chat
ipymock.browser.common.conversation_id = ''
ipymock.browser.init()
@pytest.fixture
def reset_embed_dimension(monkeypatch):
import autogpt.memory.local
monkeypatch.setattr(autogpt.memory.local, 'EMBED_DIM', 1024)
ipymock.do(
mock_openai = ipymock.browser.mock_openai,
mock_openai_embed = ipymock.llm.mock_openai_embed,
reset_embed_dimension = reset_embed_dimension,
test_auto_gpt = test_auto_gpt,
)
```
This project is still under development and lack of documentation.
This is [an article](https://seii-saintway.github.io/2023/04/06/Autonomous-Agents/) I wrote that mock openai to test autonomous robots.
## The Mechanism of PyTesting the Python Testfiles
```python
import pluggy
pm = pluggy.PluginManager('pytest')
import _pytest.hookspec
pm.add_hookspecs(_pytest.hookspec)
import _pytest.main
pm.register(_pytest.main, 'main')
import _pytest.config
cfg = _pytest.config.get_config()
cfg.parse(args=[])
pm.hook.pytest_cmdline_main(config=cfg)
```
```python
import _pytest.config
cfg = _pytest.config.get_config()
cfg.parse(args=[])
cfg.pluginmanager.hook.pytest_cmdline_main(config=cfg)
```
### PyTesting the Python Testcases within iPyNb Runtimes
```python
# content of test_time.py
import pytest
from datetime import datetime, timedelta
testdata = [
(datetime(2001, 12, 12), datetime(2001, 12, 11), timedelta(1)),
(datetime(2001, 12, 11), datetime(2001, 12, 12), timedelta(-1)),
]
def idfn(val):
if isinstance(val, (datetime,)):
# note this wouldn't show any hours/minutes/seconds
return val.strftime('%Y%m%d')
@pytest.mark.parametrize('a,b,expected', testdata)
def test_timedistance_v0(a, b, expected):
diff = a - b
assert diff == expected
@pytest.mark.parametrize('a,b,expected', testdata, ids=['forward', 'backward'])
def test_timedistance_v1(a, b, expected):
diff = a - b
assert diff == expected
@pytest.mark.parametrize('a,b,expected', testdata, ids=idfn)
def test_timedistance_v2(a, b, expected):
diff = a - b
assert diff == expected
@pytest.mark.parametrize(
'a,b,expected',
[
pytest.param(
datetime(2001, 12, 12), datetime(2001, 12, 11), timedelta(1), id='forward'
),
pytest.param(
datetime(2001, 12, 11), datetime(2001, 12, 12), timedelta(-1), id='backward'
),
],
)
def test_timedistance_v3(a, b, expected):
diff = a - b
assert diff != expected
```
```python
import _pytest.config
cfg = _pytest.config.get_config()
cfg.parse(args=[])
import _pytest.main
ss = _pytest.main.Session.from_config(cfg)
import _pytest.runner
ss._setupstate = _pytest.runner.SetupState()
import _pytest.fixtures
ss._fixturemanager = _pytest.fixtures.FixtureManager(ss)
import _pytest.python
import py
m = _pytest.python.Module.from_parent(parent=ss, fspath=py.path.local())
```
```python
class Object(object):
def __init__(self, **entries):
self.__dict__.update(entries)
m.obj = Object(**globals())
```
```python
import _pytest.runner
c = dict(enumerate(m.collect()))
for i in c:
print(f'idx = {i}')
print(_pytest.runner.call_and_report(c[i], 'setup'))
print(_pytest.runner.call_and_report(c[i], 'call'))
print(_pytest.runner.call_and_report(c[i], 'teardown', nextitem=c.get(i+1)))
```
idx = 0
idx = 1
idx = 2
idx = 3
idx = 4
idx = 5
idx = 6
idx = 7
```python
for i, f in enumerate(m.collect()):
print(f'idx = {i}')
f.setup()
f.runtest()
```
### How to Use the Do-PyTest?
```python
import pytest
@pytest.fixture
def my_fixture_1(tmpdir_factory):
return tmpdir_factory
@pytest.fixture
def my_fixture_2(tmpdir_factory):
return tmpdir_factory
def test_fixture(my_fixture_1, my_fixture_2):
assert my_fixture_1 == my_fixture_2
```
```python
from ipymock import do
```
```python
do(
my_fixture_1=my_fixture_1,
my_fixture_2=my_fixture_2,
test_fixture=test_fixture
)
```
=> no.0 nbs::test_fixture setup passed
=> no.0 nbs::test_fixture runtest passed
## Troubleshooting Tips of NbDev
- Make sure you are using the latest version of nbdev with `pip install --upgrade nbdev`
- If you are using an older version of this template, see the instructions above on how to upgrade your template.
- It is important for you to spell the name of your user and repo correctly in `settings.ini` or the website will not have the correct address from which to source assets like CSS for your site. When in doubt, you can open your browser's developer console and see if there are any errors related to fetching assets for your website due to an incorrect URL generated by misspelled values from `settings.ini`.
- If you change the name of your repo, you have to make the appropriate changes in `settings.ini`
- After you make changes to `settings.ini`, run `nbdev_build_lib && nbdev_clean_nbs && nbdev_build_docs` to make sure all changes are propagated appropriately.