Extracting entities from a Terms of Service document
Note
To download this example as a Jupyter notebook, click here.
In this example, we will use Guardrails to extract key information from a Terms-of-Service document.
Objective
We want to extract structured information about all fees and interest rates associated with the Chase credit card.
Step 0: Download PDF and load it as string
To get started, download the document from here and save it in data/chase_card_agreement.pdf.
Guardrails has some built-in functions to help with common tasks. Here, we will use the read_pdf function to load the PDF as a string.
Chase Credit Card Document: 2/25/23, 7:59 PM about:blank about:blank 1/4 PRICING INFORMATION INTEREST RATES AND INTEREST CHARGES Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prim ...
Step 1: Create the RAIL Spec
Ordinarily, we would create an RAIL spec in a separate file. For the purposes of this example, we will create the spec in this notebook as a string following the RAIL syntax. For more information on RAIL, see the RAIL documentation. We will also show the same RAIL spec in a code-first format using a Pydantic model.
Here, we request:
- A list of the fees associated with the card. We ask for sub-information, each with its own quality criteria and corrective action.
- A object (i.e. key-value pairs) for the interest.
XML option:
rail_str = """
<rail version="0.1">
<output>
<list description="What fees and charges are associated with my account?" name="fees">
<object>
<integer format="1-indexed" name="index"></integer>
<string format="lower-case; two-words" name="name" on-fail-lower-case="noop" on-fail-two-words="reask"></string>
<string format="one-line" name="explanation" on-fail-one-line="noop"></string>
<float format="percentage" name="value"></float>
</object>
</list>
<object description="What are the interest rates offered by the bank on savings and checking accounts, loans, and credit products?" name="interest_rates"></object>
</output>
<prompt>
Given the following document, answer the following questions. If the answer doesn't exist in the document, enter 'None'.
${document}
${gr.xml_prefix_prompt}
${output_schema}
${gr.json_suffix_prompt_v2_wo_none}</prompt>
</rail>
"""
Pydantic model option:
from guardrails.validators import LowerCase, TwoWords, OneLine
from pydantic import BaseModel, Field
from typing import List
prompt = """
Given the following document, answer the following questions. If the answer doesn't exist in the document, enter 'None'.
${document}
${gr.xml_prefix_prompt}
${output_schema}
${gr.json_suffix_prompt_v2_wo_none}"""
class Fee(BaseModel):
index: int = Field(validators=[("1-indexed", "noop")])
name: str = Field(validators=[LowerCase(on_fail="fix"), TwoWords(on_fail="reask")])
explanation: str = Field(validators=[OneLine()])
value: float = Field(validators=[("percentage", "noop")])
class CreditCardAgreement(BaseModel):
fees: List[Fee] = Field(description="What fees and charges are associated with my account?")
interest_rates: dict = Field(description="What are the interest rates offered by the bank on savings and checking accounts, loans, and credit products?")
Step 2: Create a Guard object with the RAIL Spec
We create a gd.Guard object that will check, validate and correct the output of the LLM. This object:
- Enforces the quality criteria specified in the RAIL spec.
- Takes corrective action when the quality criteria are not met.
- Compiles the schema and type info from the RAIL spec and adds it to the prompt.
From XML:
/home/zayd/workspace/guardrails-poc/.venv/lib/python3.11/site-packages/guardrails/schema.py:218: UserWarning: Validator 1-indexed is not valid for element integer.
warnings.warn(
/home/zayd/workspace/guardrails-poc/.venv/lib/python3.11/site-packages/guardrails/schema.py:218: UserWarning: Validator percentage is not valid for element float.
warnings.warn(
From Pydantic:
As we can see, a few formatters weren't supported. These formatters won't be enforced in the output, but this information can still be used to generate a prompt.
We see the prompt that will be sent to the LLM. The {document} is substituted with the user provided value at runtime.
Given the following document, answer the following questions. If the answer doesn't exist in the document, enter 'None'. ${document} Given below is XML that describes the information to extract from this document and the tags to extract it into. <output> <list name="fees" description="What fees and charges are associated with my account?"> <object> <integer name="index" format="1-indexed"/> <string name="name" format="lower-case; two-words"/> <string name="explanation" format="one-line"/> <float name="value" format="percentage"/> </object> </list> <object name="interest_rates" description="What are the interest rates offered by the bank on savings and checking accounts, loans, and credit products?"/> </output> ONLY return a valid JSON object (no other text is necessary). The JSON MUST conform to the XML format, including any types and format requests e.g. requests for lists, objects and specific types. Be correct and concise.
Step 3: Wrap the LLM API call with Guard
Async event loop found, but guard was invoked synchronously.For validator parallelization, please call `validate_async` instead.
Async event loop found, but guard was invoked synchronously.For validator parallelization, please call `validate_async` instead.
The guard wrapper returns the raw_llm_respose (which is a simple string), and the validated and corrected output (which is a dictionary).
We can see that the output is a dictionary with the correct schema and types.
{ 'fees': [ {'index': 1, 'name': 'annual membership', 'explanation': 'Annual Membership Fee', 'value': 0}, { 'index': 2, 'name': 'my chase', 'explanation': 'My Chase Plan Fee (fixed finance charge)', 'value': 0.0172 }, { 'index': 3, 'name': 'balance transfers', 'explanation': 'Balance Transfers Intro fee of either $5 or 3% of the amount of each transfer, whichever is greater, on transfers made within 60 days of account opening. After that: Either $5 or 5% of the amount of each transfer, whichever is greater.', 'value': 0.05 }, { 'index': 4, 'name': 'cash advances', 'explanation': 'Either $10 or 5% of the amount of each transaction, whichever is greater.', 'value': 0.05 }, { 'index': 5, 'name': 'foreign transactions', 'explanation': 'Foreign Transactions 3% of the amount of each transaction in U.S. dollars.', 'value': 0.03 }, {'index': 6, 'name': 'late payment', 'explanation': 'Late Payment Up to $40.', 'value': 0}, {'index': 7, 'name': 'over-the-credit-limit', 'explanation': 'Over-the-Credit-Limit None', 'value': 0}, {'index': 8, 'name': 'return payment', 'explanation': 'Return Payment Up to $40.', 'value': 0}, {'index': 9, 'name': 'return check', 'explanation': 'Return Check None', 'value': 0} ], 'interest_rates': { 'purchase': { 'apr': 0, 'explanation': 'Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate.' }, 'my_chase_loan': { 'apr': 19.49, 'explanation': 'My Chase Loan SM APR 19.49%. This APR will vary with the market based on the Prime Rate.' }, 'balance_transfer': { 'apr': 0, 'explanation': 'Balance Transfer APR 0% Intro APR for the first 18 months that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate.' }, 'cash_advance': { 'apr': 29.49, 'explanation': 'Cash Advance APR 29.49%. This APR will vary with the market based on the Prime Rate.' }, 'penalty': { 'apr': 29.99, 'explanation': 'Up to 29.99%. This APR will vary with the market based on the Prime Rate.' } } }
Logs ├── ╭────────────────────────────────────────────────── Step 0 ───────────────────────────────────────────────────╮ │ │ ╭──────────────────────────────────────────────── Prompt ─────────────────────────────────────────────────╮ │ │ │ │ │ │ │ │ │ Given the following document, answer the following questions. If the answer doesn't exist in the │ │ │ │ │ document, enter 'None'. │ │ │ │ │ │ │ │ │ │ 2/25/23, 7:59 PM about:blank │ │ │ │ │ about:blank 1/4 │ │ │ │ │ PRICING INFORMATION │ │ │ │ │ INTEREST RATES AND INTEREST CHARGES │ │ │ │ │ Purchase Annual │ │ │ │ │ Percentage Rate (APR) 0% Intro APR for the first 18 months that your Account is open. │ │ │ │ │ After that, 19.49%. This APR will vary with the market based on the Prime │ │ │ │ │ Rate. │ │ │ │ │ a │ │ │ │ │ My Chase Loan │ │ │ │ │ SM APR 19.49%. This APR will vary with the market based on the Prime Rate. │ │ │ │ │ a │ │ │ │ │ Promotional offers with fixed APRs and varying durations may be available from │ │ │ │ │ time to time on some accounts. │ │ │ │ │ Balance Transfer APR 0% Intro APR for the first 18 months that your Account is open. │ │ │ │ │ After that, 19.49%. This APR will vary with the market based on the Prime │ │ │ │ │ Rate. │ │ │ │ │ a │ │ │ │ │ Cash Advance APR 29.49%. This APR will vary with the market based on the Prime Rate. │ │ │ │ │ b │ │ │ │ │ Penalty APR and When │ │ │ │ │ It Applies │ │ │ │ │ Up to 29.99%. This APR will vary with the market based on the Prime Rate. │ │ │ │ │ c │ │ │ │ │ We may apply the Penalty APR to your account if you: │ │ │ │ │ fail to make a Minimum Payment by the date and time that it is due; or │ │ │ │ │ make a payment to us that is returned unpaid. │ │ │ │ │ How Long Will the Penalty APR Apply?: If we apply the Penalty APR for │ │ │ │ │ either of these reasons, the Penalty APR could potentially remain in effect │ │ │ │ │ indefinitely. │ │ │ │ │ How to Avoid Paying │ │ │ │ │ Interest on Purchases │ │ │ │ │ Your due date will be a minimum of 21 days after the close of each billing cycle. │ │ │ │ │ We will not charge you interest on new purchases if you pay your entire balance │ │ │ │ │ or Interest Saving Balance by the due date each month. We will begin charging │ │ │ │ │ interest on balance transfers and cash advances on the transaction date. │ │ │ │ │ Minimum Interest │ │ │ │ │ Charge │ │ │ │ │ None │ │ │ │ │ Credit Card Tips from │ │ │ │ │ the Consumer Financial │ │ │ │ │ Protection Bureau │ │ │ │ │ To learn more about factors to consider when applying for or using a credit card, │ │ │ │ │ visit the website of the Consumer Financial Protection Bureau at │ │ │ │ │ http://www.consumerfinance.gov/learnmore. │ │ │ │ │ FEES │ │ │ │ │ Annual Membership │ │ │ │ │ Fee │ │ │ │ │ None │ │ │ │ │ My Chase Plan │ │ │ │ │ SM Fee │ │ │ │ │ (fixed finance charge) │ │ │ │ │ Monthly fee of 0% of the amount of each eligible purchase transaction or │ │ │ │ │ amount selected to create a My Chase Plan while in the 0% Intro Purchase │ │ │ │ │ APR period. │ │ │ │ │ After that, monthly fee of 1.72% of the amount of each eligible purchase │ │ │ │ │ transaction or amount selected to create a My Chase Plan. The My Chase Plan │ │ │ │ │ Fee will be determined at the time each My Chase Plan is created and will │ │ │ │ │ remain the same until the My Chase Plan is paid in full. │ │ │ │ │ d │ │ │ │ │ Transaction Fees │ │ │ │ │ Balance Transfers Intro fee of either $5 or 3% of the amount of each transfer, whichever is greater, │ │ │ │ │ on transfers made within 60 days of account opening. After that: Either $5 or 5% │ │ │ │ │ of the amount of each transfer, whichever is greater. │ │ │ │ │ Cash Advances Either $10 or 5% of the amount of each transaction, whichever is greater. │ │ │ │ │ 2/25/23, 7:59 PM about:blank │ │ │ │ │ about:blank 2/4 │ │ │ │ │ Foreign Transactions 3% of the amount of each transaction in U.S. dollars. │ │ │ │ │ Penalty Fees │ │ │ │ │ Late Payment Up to $40. │ │ │ │ │ Over-the-Credit-Limit None │ │ │ │ │ Return Payment Up to $40. │ │ │ │ │ Return Check None │ │ │ │ │ Note: This account may not be eligible for balance transfers. │ │ │ │ │ Loss of Intro APR: We will end your introductory APR if any required Minimum Payment is 60 days late, │ │ │ │ │ and │ │ │ │ │ apply the Penalty APR. │ │ │ │ │ How We Will Calculate Your Balance: We use the daily balance method (including new transactions). │ │ │ │ │ Prime Rate: Variable APRs are based on the 7.75% Prime Rate as of 2/7/2023. │ │ │ │ │ aWe add 11.74% to the Prime Rate to determine the Purchase/My Chase Loan/Balance Transfer APR. │ │ │ │ │ Maximum APR 29.99%. │ │ │ │ │ bWe add 21.74% to the Prime Rate to determine the Cash Advance APR. Maximum APR 29.99%. │ │ │ │ │ cWe add up to 26.99% to the Prime Rate to determine the Penalty APR. Maximum APR 29.99%. │ │ │ │ │ dMy Chase Plan Fee: The My Chase Plan Fee is calculated at the time each plan is created and is based │ │ │ │ │ on │ │ │ │ │ the amount of each purchase transaction or amount selected to create the plan, the number of billing │ │ │ │ │ periods │ │ │ │ │ you choose to pay the balance in full, and other factors. The monthly and aggregate dollar amount of │ │ │ │ │ your My │ │ │ │ │ Chase Plan Fee will be disclosed during the activation of each My Chase Plan. │ │ │ │ │ MILITARY LENDING ACT NOTICE: Federal law provides important protections to members of the Armed │ │ │ │ │ Forces and their dependents relating to extensions of consumer credit. In general, the cost of consumer │ │ │ │ │ credit │ │ │ │ │ to a member of the Armed Forces and his or her dependent may not exceed an annual percentage rate of 36 │ │ │ │ │ percent. This rate must include, as applicable to the credit transaction or account: the costs │ │ │ │ │ associated with │ │ │ │ │ credit insurance premiums; fees for ancillary products sold in connection with the credit transaction; │ │ │ │ │ any │ │ │ │ │ application fee charged (other than certain application fees for specified credit transactions or │ │ │ │ │ accounts); and │ │ │ │ │ any participation fee charged (other than certain participation fees for a credit card account). To │ │ │ │ │ receive this │ │ │ │ │ information and a description of your payment obligation verbally, please call 1-800-235-9978. │ │ │ │ │ TERMS & CONDITIONS │ │ │ │ │ Authorization: When you respond to this credit card offer from JPMorgan Chase Bank, N.A., Member FDIC, │ │ │ │ │ a │ │ │ │ │ subsidiary of JPMorgan Chase & Co. ("Chase", "we", or "us"), you agree to the following: │ │ │ │ │ 1. You authorize us to obtain credit bureau reports, employment, and income information about you that │ │ │ │ │ we │ │ │ │ │ will use when considering your application for credit. We may obtain and use information about your │ │ │ │ │ accounts with us and others such as Checking, Deposit, Investment, and Utility accounts from credit │ │ │ │ │ bureaus and other entities. You also authorize us to obtain credit bureau reports and any other │ │ │ │ │ information about you in connection with: 1) extensions of credit on your account; 2) the │ │ │ │ │ administration, │ │ │ │ │ review or collection of your account; and 3) offering you enhanced or additional products and services. │ │ │ │ │ If │ │ │ │ │ you ask, we will tell you the name and address of the credit bureau from which we obtained a report │ │ │ │ │ about you. │ │ │ │ │ 2. If an account is opened, you will receive a Cardmember Agreement with your card(s). You agree to the │ │ │ │ │ terms of this agreement by: using the account or any card, authorizing their use, or making any payment │ │ │ │ │ on the account. │ │ │ │ │ 3. By providing your mobile ph │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ Given below is XML that describes the information to extract from this document and the tags to extract │ │ │ │ │ it into. │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ <output> │ │ │ │ │ <list name="fees" description="What fees and charges are associated with my account?"> │ │ │ │ │ <object> │ │ │ │ │ <integer name="index" format="1-indexed"/> │ │ │ │ │ <string name="name" format="lower-case; two-words"/> │ │ │ │ │ <string name="explanation" format="one-line"/> │ │ │ │ │ <float name="value" format="percentage"/> │ │ │ │ │ </object> │ │ │ │ │ </list> │ │ │ │ │ <object name="interest_rates" description="What are the interest rates offered by the bank on │ │ │ │ │ savings and checking accounts, loans, and credit products?"/> │ │ │ │ │ </output> │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ ONLY return a valid JSON object (no other text is necessary). The JSON MUST conform to the XML format, │ │ │ │ │ including any types and format requests e.g. requests for lists, objects and specific types. Be correct │ │ │ │ │ and concise. │ │ │ │ │ │ │ │ │ │ │ │ │ │ │ Json Output: │ │ │ │ │ │ │ │ │ │ │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ │ ╭──────────────────────────────────────────── Message History ────────────────────────────────────────────╮ │ │ │ │ ┏━━━━━━┳━━━━━━━━━┓ │ │ │ │ │ ┃ Role ┃ Content ┃ │ │ │ │ │ ┡━━━━━━╇━━━━━━━━━┩ │ │ │ │ │ └──────┴─────────┘ │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ │ ╭──────────────────────────────────────────── Raw LLM Output ─────────────────────────────────────────────╮ │ │ │ │ { │ │ │ │ │ "fees": [ │ │ │ │ │ { │ │ │ │ │ "index": 1, │ │ │ │ │ "name": "annual membership", │ │ │ │ │ "explanation": "Annual Membership Fee", │ │ │ │ │ "value": 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 2, │ │ │ │ │ "name": "my chase plan", │ │ │ │ │ "explanation": "My Chase Plan Fee (fixed finance charge)", │ │ │ │ │ "value": 1.72 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 3, │ │ │ │ │ "name": "balance transfers", │ │ │ │ │ "explanation": "Balance Transfers Intro fee of either $5 or 3% of the amount of each │ │ │ │ │ transfer, whichever is greater, on transfers made within 60 days of account opening. After that: Either │ │ │ │ │ $5 or 5% of the amount of each transfer, whichever is greater.", │ │ │ │ │ "value": 0.05 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 4, │ │ │ │ │ "name": "cash advances", │ │ │ │ │ "explanation": "Either $10 or 5% of the amount of each transaction, whichever is greater.", │ │ │ │ │ "value": 0.05 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 5, │ │ │ │ │ "name": "foreign transactions", │ │ │ │ │ "explanation": "Foreign Transactions 3% of the amount of each transaction in U.S. │ │ │ │ │ dollars.", │ │ │ │ │ "value": 0.03 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 6, │ │ │ │ │ "name": "late payment", │ │ │ │ │ "explanation": "Late Payment Up to $40.", │ │ │ │ │ "value": 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 7, │ │ │ │ │ "name": "over-the-credit-limit", │ │ │ │ │ "explanation": "Over-the-Credit-Limit None", │ │ │ │ │ "value": 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 8, │ │ │ │ │ "name": "return payment", │ │ │ │ │ "explanation": "Return Payment Up to $40.", │ │ │ │ │ "value": 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ "index": 9, │ │ │ │ │ "name": "return check", │ │ │ │ │ "explanation": "Return Check None", │ │ │ │ │ "value": 0 │ │ │ │ │ } │ │ │ │ │ ], │ │ │ │ │ "interest_rates": { │ │ │ │ │ "purchase": { │ │ │ │ │ "apr": 0, │ │ │ │ │ "explanation": "Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months │ │ │ │ │ that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime │ │ │ │ │ Rate." │ │ │ │ │ }, │ │ │ │ │ "my_chase_loan": { │ │ │ │ │ "apr": 19.49, │ │ │ │ │ "explanation": "My Chase Loan SM APR 19.49%. This APR will vary with the market based on │ │ │ │ │ the Prime Rate." │ │ │ │ │ }, │ │ │ │ │ "balance_transfer": { │ │ │ │ │ "apr": 0, │ │ │ │ │ "explanation": "Balance Transfer APR 0% Intro APR for the first 18 months that your Account │ │ │ │ │ is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate." │ │ │ │ │ }, │ │ │ │ │ "cash_advance": { │ │ │ │ │ "apr": 29.49, │ │ │ │ │ "explanation": "Cash Advance APR 29.49%. This APR will vary with the market based on the │ │ │ │ │ Prime Rate." │ │ │ │ │ }, │ │ │ │ │ "penalty": { │ │ │ │ │ "apr": 29.99, │ │ │ │ │ "explanation": "Up to 29.99%. This APR will vary with the market based on the Prime Rate." │ │ │ │ │ } │ │ │ │ │ } │ │ │ │ │ } │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ │ ╭─────────────────────────────────────────── Validated Output ────────────────────────────────────────────╮ │ │ │ │ { │ │ │ │ │ 'fees': [ │ │ │ │ │ { │ │ │ │ │ 'index': 1, │ │ │ │ │ 'name': 'annual membership', │ │ │ │ │ 'explanation': 'Annual Membership Fee', │ │ │ │ │ 'value': 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 2, │ │ │ │ │ 'name': FieldReAsk( │ │ │ │ │ incorrect_value='my chase plan', │ │ │ │ │ fail_results=[ │ │ │ │ │ FailResult( │ │ │ │ │ outcome='fail', │ │ │ │ │ metadata=None, │ │ │ │ │ error_message='must be exactly two words', │ │ │ │ │ fix_value='my chase' │ │ │ │ │ ) │ │ │ │ │ ], │ │ │ │ │ path=['fees', 1, 'name'] │ │ │ │ │ ), │ │ │ │ │ 'explanation': 'My Chase Plan Fee (fixed finance charge)', │ │ │ │ │ 'value': 1.72 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 3, │ │ │ │ │ 'name': 'balance transfers', │ │ │ │ │ 'explanation': 'Balance Transfers Intro fee of either $5 or 3% of the amount of each │ │ │ │ │ transfer, whichever is greater, on transfers made within 60 days of account opening. After that: Either │ │ │ │ │ $5 or 5% of the amount of each transfer, whichever is greater.', │ │ │ │ │ 'value': 0.05 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 4, │ │ │ │ │ 'name': 'cash advances', │ │ │ │ │ 'explanation': 'Either $10 or 5% of the amount of each transaction, whichever is greater.', │ │ │ │ │ 'value': 0.05 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 5, │ │ │ │ │ 'name': 'foreign transactions', │ │ │ │ │ 'explanation': 'Foreign Transactions 3% of the amount of each transaction in U.S. │ │ │ │ │ dollars.', │ │ │ │ │ 'value': 0.03 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 6, │ │ │ │ │ 'name': 'late payment', │ │ │ │ │ 'explanation': 'Late Payment Up to $40.', │ │ │ │ │ 'value': 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 7, │ │ │ │ │ 'name': FieldReAsk( │ │ │ │ │ incorrect_value='over-the-credit-limit', │ │ │ │ │ fail_results=[ │ │ │ │ │ FailResult( │ │ │ │ │ outcome='fail', │ │ │ │ │ metadata=None, │ │ │ │ │ error_message='must be exactly two words', │ │ │ │ │ fix_value='over-the-credit-limit' │ │ │ │ │ ) │ │ │ │ │ ], │ │ │ │ │ path=['fees', 6, 'name'] │ │ │ │ │ ), │ │ │ │ │ 'explanation': 'Over-the-Credit-Limit None', │ │ │ │ │ 'value': 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 8, │ │ │ │ │ 'name': 'return payment', │ │ │ │ │ 'explanation': 'Return Payment Up to $40.', │ │ │ │ │ 'value': 0 │ │ │ │ │ }, │ │ │ │ │ { │ │ │ │ │ 'index': 9, │ │ │ │ │ 'name': 'return check', │ │ │ │ │ 'explanation': 'Return Check None', │ │ │ │ │ 'value': 0 │ │ │ │ │ } │ │ │ │ │ ], │ │ │ │ │ 'interest_rates': { │ │ │ │ │ 'purchase': { │ │ │ │ │ 'apr': 0, │ │ │ │ │ 'explanation': 'Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months │ │ │ │ │ that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime │ │ │ │ │ Rate.' │ │ │ │ │ }, │ │ │ │ │ 'my_chase_loan': { │ │ │ │ │ 'apr': 19.49, │ │ │ │ │ 'explanation': 'My Chase Loan SM APR 19.49%. This APR will vary with the market based on │ │ │ │ │ the Prime Rate.' │ │ │ │ │ }, │ │ │ │ │ 'balance_transfer': { │ │ │ │ │ 'apr': 0, │ │ │ │ │ 'explanation': 'Balance Transfer APR 0% Intro APR for the first 18 months that your Account │ │ │ │ │ is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate.' │ │ │ │ │ }, │ │ │ │ │ 'cash_advance': { │ │ │ │ │ 'apr': 29.49, │ │ │ │ │ 'explanation': 'Cash Advance APR 29.49%. This APR will vary with the market based on the │ │ │ │ │ Prime Rate.' │ │ │ │ │ }, │ │ │ │ │ 'penalty': { │ │ │ │ │ 'apr': 29.99, │ │ │ │ │ 'explanation': 'Up to 29.99%. This APR will vary with the market based on the Prime Rate.' │ │ │ │ │ } │ │ │ │ │ } │ │ │ │ │ } │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────╯ └── ╭────────────────────────────────────────────────── Step 1 ───────────────────────────────────────────────────╮ │ ╭──────────────────────────────────────────────── Prompt ─────────────────────────────────────────────────╮ │ │ │ │ │ │ │ I was given the following JSON response, which had problems due to incorrect values. │ │ │ │ │ │ │ │ { │ │ │ │ "fees": [ │ │ │ │ { │ │ │ │ "index": 1, │ │ │ │ "name": "annual membership", │ │ │ │ "explanation": "Annual Membership Fee", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 2, │ │ │ │ "name": { │ │ │ │ "incorrect_value": "my chase plan", │ │ │ │ "error_messages": [ │ │ │ │ "must be exactly two words" │ │ │ │ ] │ │ │ │ }, │ │ │ │ "explanation": "My Chase Plan Fee (fixed finance charge)", │ │ │ │ "value": 1.72 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 3, │ │ │ │ "name": "balance transfers", │ │ │ │ "explanation": "Balance Transfers Intro fee of either $5 or 3% of the amount of each transfer, │ │ │ │ whichever is greater, on transfers made within 60 days of account opening. After that: Either $5 or 5% │ │ │ │ of the amount of each transfer, whichever is greater.", │ │ │ │ "value": 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 4, │ │ │ │ "name": "cash advances", │ │ │ │ "explanation": "Either $10 or 5% of the amount of each transaction, whichever is greater.", │ │ │ │ "value": 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 5, │ │ │ │ "name": "foreign transactions", │ │ │ │ "explanation": "Foreign Transactions 3% of the amount of each transaction in U.S. dollars.", │ │ │ │ "value": 0.03 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 6, │ │ │ │ "name": "late payment", │ │ │ │ "explanation": "Late Payment Up to $40.", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 7, │ │ │ │ "name": { │ │ │ │ "incorrect_value": "over-the-credit-limit", │ │ │ │ "error_messages": [ │ │ │ │ "must be exactly two words" │ │ │ │ ] │ │ │ │ }, │ │ │ │ "explanation": "Over-the-Credit-Limit None", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 8, │ │ │ │ "name": "return payment", │ │ │ │ "explanation": "Return Payment Up to $40.", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 9, │ │ │ │ "name": "return check", │ │ │ │ "explanation": "Return Check None", │ │ │ │ "value": 0 │ │ │ │ } │ │ │ │ ], │ │ │ │ "interest_rates": { │ │ │ │ "purchase": { │ │ │ │ "apr": 0, │ │ │ │ "explanation": "Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months that │ │ │ │ your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate." │ │ │ │ }, │ │ │ │ "my_chase_loan": { │ │ │ │ "apr": 19.49, │ │ │ │ "explanation": "My Chase Loan SM APR 19.49%. This APR will vary with the market based on the │ │ │ │ Prime Rate." │ │ │ │ }, │ │ │ │ "balance_transfer": { │ │ │ │ "apr": 0, │ │ │ │ "explanation": "Balance Transfer APR 0% Intro APR for the first 18 months that your Account is │ │ │ │ open. After that, 19.49%. This APR will vary with the market based on the Prime Rate." │ │ │ │ }, │ │ │ │ "cash_advance": { │ │ │ │ "apr": 29.49, │ │ │ │ "explanation": "Cash Advance APR 29.49%. This APR will vary with the market based on the Prime │ │ │ │ Rate." │ │ │ │ }, │ │ │ │ "penalty": { │ │ │ │ "apr": 29.99, │ │ │ │ "explanation": "Up to 29.99%. This APR will vary with the market based on the Prime Rate." │ │ │ │ } │ │ │ │ } │ │ │ │ } │ │ │ │ │ │ │ │ Help me correct the incorrect values based on the given error messages. │ │ │ │ │ │ │ │ Given below is XML that describes the information to extract from this document and the tags to extract │ │ │ │ it into. │ │ │ │ │ │ │ │ <output> │ │ │ │ <list name="fees" description="What fees and charges are associated with my account?"> │ │ │ │ <object> │ │ │ │ <integer name="index" format="1-indexed"/> │ │ │ │ <string name="name" format="lower-case; two-words"/> │ │ │ │ <string name="explanation" format="one-line"/> │ │ │ │ <float name="value" format="percentage"/> │ │ │ │ </object> │ │ │ │ </list> │ │ │ │ <object name="interest_rates" description="What are the interest rates offered by the bank on │ │ │ │ savings and checking accounts, loans, and credit products?"/> │ │ │ │ </output> │ │ │ │ │ │ │ │ │ │ │ │ ONLY return a valid JSON object (no other text is necessary), where the key of the field in JSON is the │ │ │ │ `name` attribute of the corresponding XML, and the value is of the type specified by the corresponding │ │ │ │ XML's tag. The JSON MUST conform to the XML format, including any types and format requests e.g. │ │ │ │ requests for lists, objects and specific types. Be correct and concise. If you are unsure anywhere, │ │ │ │ enter `null`. │ │ │ │ │ │ │ │ │ │ │ │ Json Output: │ │ │ │ │ │ │ │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ ╭───────────────────────────────────────────── Instructions ──────────────────────────────────────────────╮ │ │ │ │ │ │ │ You are a helpful assistant only capable of communicating with valid JSON, and no other text. │ │ │ │ │ │ │ │ ONLY return a valid JSON object (no other text is necessary), where the key of the field in JSON is the │ │ │ │ `name` attribute of the corresponding XML, and the value is of the type specified by the corresponding │ │ │ │ XML's tag. The JSON MUST conform to the XML format, including any types and format requests e.g. │ │ │ │ requests for lists, objects and specific types. Be correct and concise. If you are unsure anywhere, │ │ │ │ enter `null`. │ │ │ │ │ │ │ │ Here are examples of simple (XML, JSON) pairs that show the expected behavior: │ │ │ │ - `<string name='foo' format='two-words lower-case' />` => `{'foo': 'example one'}` │ │ │ │ - `<list name='bar'><string format='upper-case' /></list>` => `{"bar": ['STRING ONE', 'STRING TWO', │ │ │ │ etc.]}` │ │ │ │ - `<object name='baz'><string name="foo" format="capitalize two-words" /><integer name="index" │ │ │ │ format="1-indexed" /></object>` => `{'baz': {'foo': 'Some String', 'index': 1}}` │ │ │ │ │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ ╭──────────────────────────────────────────── Message History ────────────────────────────────────────────╮ │ │ │ No message history. │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ ╭──────────────────────────────────────────── Raw LLM Output ─────────────────────────────────────────────╮ │ │ │ { │ │ │ │ "fees": [ │ │ │ │ { │ │ │ │ "index": 1, │ │ │ │ "name": "annual membership", │ │ │ │ "explanation": "Annual Membership Fee", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 2, │ │ │ │ "name": "my chase plan", │ │ │ │ "explanation": "My Chase Plan Fee (fixed finance charge)", │ │ │ │ "value": 0.0172 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 3, │ │ │ │ "name": "balance transfers", │ │ │ │ "explanation": "Balance Transfers Intro fee of either $5 or 3% of the amount of each transfer, │ │ │ │ whichever is greater, on transfers made within 60 days of account opening. After that: Either $5 or 5% │ │ │ │ of the amount of each transfer, whichever is greater.", │ │ │ │ "value": 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 4, │ │ │ │ "name": "cash advances", │ │ │ │ "explanation": "Either $10 or 5% of the amount of each transaction, whichever is greater.", │ │ │ │ "value": 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 5, │ │ │ │ "name": "foreign transactions", │ │ │ │ "explanation": "Foreign Transactions 3% of the amount of each transaction in U.S. dollars.", │ │ │ │ "value": 0.03 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 6, │ │ │ │ "name": "late payment", │ │ │ │ "explanation": "Late Payment Up to $40.", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 7, │ │ │ │ "name": "over-the-credit-limit", │ │ │ │ "explanation": "Over-the-Credit-Limit None", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 8, │ │ │ │ "name": "return payment", │ │ │ │ "explanation": "Return Payment Up to $40.", │ │ │ │ "value": 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ "index": 9, │ │ │ │ "name": "return check", │ │ │ │ "explanation": "Return Check None", │ │ │ │ "value": 0 │ │ │ │ } │ │ │ │ ], │ │ │ │ "interest_rates": { │ │ │ │ "purchase": { │ │ │ │ "apr": 0, │ │ │ │ "explanation": "Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months that │ │ │ │ your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate." │ │ │ │ }, │ │ │ │ "my_chase_loan": { │ │ │ │ "apr": 19.49, │ │ │ │ "explanation": "My Chase Loan SM APR 19.49%. This APR will vary with the market based on the │ │ │ │ Prime Rate." │ │ │ │ }, │ │ │ │ "balance_transfer": { │ │ │ │ "apr": 0, │ │ │ │ "explanation": "Balance Transfer APR 0% Intro APR for the first 18 months that your Account is │ │ │ │ open. After that, 19.49%. This APR will vary with the market based on the Prime Rate." │ │ │ │ }, │ │ │ │ "cash_advance": { │ │ │ │ "apr": 29.49, │ │ │ │ "explanation": "Cash Advance APR 29.49%. This APR will vary with the market based on the Prime │ │ │ │ Rate." │ │ │ │ }, │ │ │ │ "penalty": { │ │ │ │ "apr": 29.99, │ │ │ │ "explanation": "Up to 29.99%. This APR will vary with the market based on the Prime Rate." │ │ │ │ } │ │ │ │ } │ │ │ │ } │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ │ ╭─────────────────────────────────────────── Validated Output ────────────────────────────────────────────╮ │ │ │ { │ │ │ │ 'fees': [ │ │ │ │ { │ │ │ │ 'index': 1, │ │ │ │ 'name': 'annual membership', │ │ │ │ 'explanation': 'Annual Membership Fee', │ │ │ │ 'value': 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 2, │ │ │ │ 'name': 'my chase', │ │ │ │ 'explanation': 'My Chase Plan Fee (fixed finance charge)', │ │ │ │ 'value': 0.0172 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 3, │ │ │ │ 'name': 'balance transfers', │ │ │ │ 'explanation': 'Balance Transfers Intro fee of either $5 or 3% of the amount of each │ │ │ │ transfer, whichever is greater, on transfers made within 60 days of account opening. After that: Either │ │ │ │ $5 or 5% of the amount of each transfer, whichever is greater.', │ │ │ │ 'value': 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 4, │ │ │ │ 'name': 'cash advances', │ │ │ │ 'explanation': 'Either $10 or 5% of the amount of each transaction, whichever is greater.', │ │ │ │ 'value': 0.05 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 5, │ │ │ │ 'name': 'foreign transactions', │ │ │ │ 'explanation': 'Foreign Transactions 3% of the amount of each transaction in U.S. │ │ │ │ dollars.', │ │ │ │ 'value': 0.03 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 6, │ │ │ │ 'name': 'late payment', │ │ │ │ 'explanation': 'Late Payment Up to $40.', │ │ │ │ 'value': 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 7, │ │ │ │ 'name': 'over-the-credit-limit', │ │ │ │ 'explanation': 'Over-the-Credit-Limit None', │ │ │ │ 'value': 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 8, │ │ │ │ 'name': 'return payment', │ │ │ │ 'explanation': 'Return Payment Up to $40.', │ │ │ │ 'value': 0 │ │ │ │ }, │ │ │ │ { │ │ │ │ 'index': 9, │ │ │ │ 'name': 'return check', │ │ │ │ 'explanation': 'Return Check None', │ │ │ │ 'value': 0 │ │ │ │ } │ │ │ │ ], │ │ │ │ 'interest_rates': { │ │ │ │ 'purchase': { │ │ │ │ 'apr': 0, │ │ │ │ 'explanation': 'Purchase Annual Percentage Rate (APR) 0% Intro APR for the first 18 months │ │ │ │ that your Account is open. After that, 19.49%. This APR will vary with the market based on the Prime │ │ │ │ Rate.' │ │ │ │ }, │ │ │ │ 'my_chase_loan': { │ │ │ │ 'apr': 19.49, │ │ │ │ 'explanation': 'My Chase Loan SM APR 19.49%. This APR will vary with the market based on │ │ │ │ the Prime Rate.' │ │ │ │ }, │ │ │ │ 'balance_transfer': { │ │ │ │ 'apr': 0, │ │ │ │ 'explanation': 'Balance Transfer APR 0% Intro APR for the first 18 months that your Account │ │ │ │ is open. After that, 19.49%. This APR will vary with the market based on the Prime Rate.' │ │ │ │ }, │ │ │ │ 'cash_advance': { │ │ │ │ 'apr': 29.49, │ │ │ │ 'explanation': 'Cash Advance APR 29.49%. This APR will vary with the market based on the │ │ │ │ Prime Rate.' │ │ │ │ }, │ │ │ │ 'penalty': { │ │ │ │ 'apr': 29.99, │ │ │ │ 'explanation': 'Up to 29.99%. This APR will vary with the market based on the Prime Rate.' │ │ │ │ } │ │ │ │ } │ │ │ │ } │ │ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────╯ │ ╰─────────────────────────────────────────────────────────────────────────────────────────────────────────────╯