ToolUserAgent

import asyncio
import os
 
import openai
import tiktoken
from embedia import ChatLLM, Tokenizer
from embedia.agents import ToolUserAgent
from embedia.tools import PythonInterpreterTool, TerminalTool
 
 
class OpenAITokenizer(Tokenizer):
    def __init__(self):
        super().__init__()
 
    async def _tokenize(self, text):
        return tiktoken.encoding_for_model("gpt-3.5-turbo").encode(text)
 
 
class OpenAIChatLLM(ChatLLM):
    def __init__(self):
        super().__init__(tokenizer=OpenAITokenizer())
        openai.api_key = os.environ["OPENAI_API_KEY"]
 
    async def _reply(self, prompt):
        completion = await openai.ChatCompletion.acreate(
            model="gpt-3.5-turbo",
            temperature=0.1,
            messages=[
                {"role": msg.role, "content": msg.content} for msg in self.chat_history
            ],
        )
        return completion.choices[0].message.content
 
 
if __name__ == "__main__":
    tool_user_agent = ToolUserAgent(
        chatllm=OpenAIChatLLM(), tools=[PythonInterpreterTool(), TerminalTool()]
    )
    resp = asyncio.run(
        tool_user_agent(
            "Count the number of lines of code (without empty lines) in main.py"
        )
    )

[time: 2023-10-05T16:08:11.107019+05:30] [id: 140095190135312] [event: Tool Start]
Tool: ToolUserAgent
Args: ('Count the number of lines of code (without empty lines) in main.py',)
Kwargs: {}
 
[time: 2023-10-05T16:08:11.107092+05:30] [id: 140095190135312] [event: Agent Start]
Main Question:
Count the number of lines of code (without empty lines) in main.py
 
[time: 2023-10-05T16:08:11.224911+05:30] [id: 140095207849232] [event: ChatLLM Init]
system (40 tokens):
You're an expert in choosing the best tool for answering the user's question.
The list of tools and their descriptions will be provided to you.
Reply with the name of the chosen tool and nothing else
 
[time: 2023-10-05T16:08:11.256197+05:30] [id: 140095207849232] [event: ChatLLM Start]
user (42 tokens):
Question: Count the number of lines of code (without empty lines) in main.py
 
 Tools:
Python Interpreter: Runs the provided python code in the current interpreter
Terminal: Run the provided commands in the shell
 
[time: 2023-10-05T16:08:12.736856+05:30] [id: 140095207849232] [event: ChatLLM End]
assistant (2 tokens):
Python Interpreter
 
[time: 2023-10-05T16:08:12.781312+05:30] [id: 140095673279376] [event: ChatLLM Init]
system (81 tokens):
You're an expert in choosing the function arguments based on the user's question.
The question, the function description, the list of parameters and their descriptions
will be provided to you. Reply with all arguments in the following json format:
{
    <parameter name>: <argument value>,
    <parameter name>: <argument value>,
    <parameter name>: <argument value>,
}
Do not reply with anything else
 
[time: 2023-10-05T16:08:12.825028+05:30] [id: 140095673279376] [event: ChatLLM Start]
user (73 tokens):
Question: Count the number of lines of code (without empty lines) in main.py
Function: Runs the provided python code in the current interpreter
Parameters:
code: Python code to be run (type: str)
vars: A python dictionary containing variables to be passed to the code
timeout: Timeout in seconds (type: int). Defaults to 60.
 
 
[time: 2023-10-05T16:08:17.067839+05:30] [id: 140095673279376] [event: ChatLLM End]
assistant (74 tokens):
{
    "code": "with open('main.py', 'r') as file:\n    lines = file.readlines()\n    non_empty_lines = [line for line in lines if line.strip() != '']\n    line_count = len(non_empty_lines)\n    print(line_count)",
    "vars": {},
    "timeout": 60
}
 
Tool: ToolUserAgent
Details: {'tool': 'Python Interpreter', 'args': {'code': "with open('main.py', 'r') as file:\n    lines = file.readlines()\n    non_empty_lines = [line for line in lines if line.strip() != '']\n    line_count = len(non_empty_lines)\n    print(line_count)", 'vars': {}, 'timeout': 60}} Confirm (y/n): y
 
[time: 2023-10-05T16:08:31.952483+05:30] [id: 140095732346320] [event: Tool Start]
Tool: PythonInterpreterTool
Args: ()
Kwargs: {'code': "with open('main.py', 'r') as file:\n    lines = file.readlines()\n    non_empty_lines = [line for line in lines if line.strip() != '']\n    line_count = len(non_empty_lines)\n    print(line_count)", 'vars': {}, 'timeout': 60}
 
[time: 2023-10-05T16:08:31.963782+05:30] [id: 140095732346320] [event: Tool End]
Tool: PythonInterpreterTool
ExitCode: 0
Output:
34
 
[time: 2023-10-05T16:08:32.025006+05:30] [id: 140095190135312] [event: Agent Step]
Question: Count the number of lines of code (without empty lines) in main.py
ToolChoice: Python Interpreter
ToolArgs: {'code': "with open('main.py', 'r') as file:\n    lines = file.readlines()\n    non_empty_lines = [line for line in lines if line.strip() != '']\n    line_count = len(non_empty_lines)\n    print(line_count)", 'vars': {}, 'timeout': 60}
ToolExitCode: 0
ToolOutput: 34
 
[time: 2023-10-05T16:08:32.058926+05:30] [id: 140095190069328] [event: ChatLLM Init]
system (113 tokens):
You're an expert in deciding what next question should be asked (if any) to reach the final answer.
Your question will be acted upon and its result will be provided to you. This will repeat until we reach the final answer.
The main question, actions taken till now and their results will be provided to you.
If we've reached the final answer, reply with the answer in the following format:
Final Answer: <final answer>
If not, reply with the next question in the following format:
Question: <next question>
Do not reply with anything else
 
[time: 2023-10-05T16:08:32.094455+05:30] [id: 140095190069328] [event: ChatLLM Start]
user (42 tokens):
Main question: Count the number of lines of code (without empty lines) in main.py
 
Question: Count the number of lines of code (without empty lines) in main.py
 Output: 34
 
[time: 2023-10-05T16:08:33.368412+05:30] [id: 140095190069328] [event: ChatLLM End]
assistant (5 tokens):
Final Answer: 34
 
[time: 2023-10-05T16:08:33.419216+05:30] [id: 140095190135312] [event: Agent End]
Final Answer:
 34
 
[time: 2023-10-05T16:08:33.452890+05:30] [id: 140095190135312] [event: Tool End]
Tool: ToolUserAgent
ExitCode: 0
Output:
 34