What's Changed

• Add setup files for the repo by @BenConstable9 in #1
• Add initial text2sql code and notebooks by @BenConstable9 in #2
• deps(deps): bump semantic-kernel from 1.8.0 to 1.8.2 by @dependabot in #4
• deps(deps): bump azure-search-documents from 11.6.0b3 to 11.6.0b4 by @dependabot in #3
• Fix chat history object by @BenConstable9 in #5
• Improve the READMEs and add documentation for ADI Skill by @BenConstable9 in #7
• deps(deps): bump semantic-kernel from 1.8.2 to 1.8.3 by @dependabot in #8
• Add Open Source Headers by @BenConstable9 in #9
• Feature/adi skillset by @priyal1508 in #11
• Add Vector Based Text2SQL Code and Approach by @BenConstable9 in #14
• Fix several bugs in the ADI image understanding function app. by @BenConstable9 in #16
• Bump nltk from 3.8.1 to 3.9 in /adi_function_app by @dependabot in #13
• deps(deps): bump nltk from 3.9 to 3.9.1 by @dependabot in #18
• Add a query cache POC into Text2SQL by @BenConstable9 in #19
• Add Pre Commit checks by @BenConstable9 in #20
• Return Source Uris for Figures by @BenConstable9 in #22
• deps(deps): bump semantic-kernel from 1.8.3 to 1.9.0 by @dependabot in #32
• exclude certain terms from key phrase processing and removal of figurecontent tag from adi output by @PoulamiDasDA in #33
• deps(deps): bump azure-search-documents from 11.6.0b4 to 11.6.0b5 by @dependabot in #31
• Add Skip Straight to SQL Query Execution Option and Include REsults by @BenConstable9 in #34
• Automatic Metadata Collection by @BenConstable9 in #40
• deps(deps): bump azure-search-documents from 11.6.0b5 to 11.6.0b6 by @dependabot in #41
• Feature/documentation by @priyal1508 in #43
• Update doc for Text2SQL by @BenConstable9 in #44
• Filter out empty pages when using page wise chunking by @BenConstable9 in #45
• Use async instead of threadpool by @BenConstable9 in #46
• Bug fixes in key phrase and pre embedding cleaner by @BenConstable9 in #47
• Perform section extraction only in pre-embedding cleaner by @BenConstable9 in #48
• Schema Store Improvements by @BenConstable9 in #50
• Update the Documentation for Caching by @BenConstable9 in #51
• Add Snowflake Metadata Collection Script by @BenConstable9 in #49
• Databricks Data Dictionary Creator by @BenConstable9 in #54
• Initial AutoGen Work - Still WIP by @BenConstable9 in #55
• Update licenses by @BenConstable9 in #56
• Add Semantic Chunking Code by @BenConstable9 in #58
• Fix bug in heading seperation by @BenConstable9 in #59
• deps(deps): bump azure-search-documents from 11.6.0b6 to 11.6.0b8 by @dependabot in #57
• AutoGen Improvements by @BenConstable9 in #61
• Add optional query cache indexer by @BenConstable9 in #66
• Clean up SK code by @BenConstable9 in #69
• Improve Agentic Setup and add DateTime Tool by @BenConstable9 in #70
• Add packaging for Modulisation by @BenConstable9 in #71
• Bug fixes in Databricks Data Dictionary Creator by @BenConstable9 in #72
• Data Dictionary Updates by @BenConstable9 in #81
• Fix Lock File by @BenConstable9 in #82
• Remove limit from debugging by @BenConstable9 in #83
• Significant Improvements to Agentic Flow by @BenConstable9 in #91
• Agent Disambiguation by @BenConstable9 in #94
• Fix bug in Databricks Data dicationary by @BenConstable9 in #97
• Fix #90: Implement Query Rewrite Agent for comprehensive preprocessing by @minhyeong112 in #100
• Improves disambiguation & answer agent by @BenConstable9 in #99
• Fix bad changes by @BenConstable9 in #101
• Fix Entity Relationship Graph & Add Extra Data Dictionary CLI Command by @BenConstable9 in #102
• Update rewriter agent to support chat history by @BenConstable9 in #104
• Parameter Cache Rendering by @BenConstable9 in #106
• Update Cache Documentation by @BenConstable9 in #107
• Update prompts and agents to support programmatic sources by @BenConstable9 in #108
• Update prompts and agent flow for improved Text2SQL by @minhyeong112 in #105
• Add chat history rewriter back into agent by @BenConstable9 in #111
• Fix no tool ability by @BenConstable9 in #112
• Transpile with the read engine by @BenConstable9 in #113
• Parallel Agent Execution by @BenConstable9 in #115
• Move old iterations to sub directory by @BenConstable9 in #117
• Adds data contract and reduces agent calls. by @BenConstable9 in #119
• Fix Bad Chat History Implementation by @BenConstable9 in #120
• Update message types to have common schema by @BenConstable9 in #121
• Change OpenAI to use Identity Provider by @BenConstable9 in #122
• Add a query validation for attempting to find malicious sql queries by @BenConstable9 in #126
• Feature/parsing and error handling by @minhyeong112 in #128
• PostgreSQL Support by @BenConstable9 in #127
• Fix parallel query generation exception by moving to structured output mode by @BenConstable9 in #129
• Add prompt filtering to attempt to filter malicious prompts by @BenConstable9 in #132
• Add Basic Engine Specific Instructions into Connectors by @BenConstable9 in #134
• feat: Add Spider dataset evaluation framework and SQLite support by @minhyeong112 in #131
• Payload and Disambiguation Improvements by @BenConstable9 in #135
• Expose payloads by @BenConstable9 in #136
• Update documentation and diagrams by @BenConstable9 in #137
• Update docs by @BenConstable9 in #138
• Fix import error for text2sql and improve naming by @BenConstable9 in #139
• Improve disambiguation process and answer generation by @BenConstable9 in #141
• Add example env file for text2sql by @BenConstable9 in #142
• Update prompts and instruct that questions may be relevant in context by @BenConstable9 in #143
• Normalise environment variables by @BenConstable9 in #144
• Split Image Processing for multiple stage processing and fix bugs by @BenConstable9 in #140
• Fix Image Processing ReadMe by @BenConstable9 in #146

New Contributors

• @dependabot made their first contribution in #4
• @priyal1508 made their first contribution in #11
• @PoulamiDasDA made their first contribution in #33
• @minhyeong112 made their first contribution in #100

Full Changelog: https://github.com/microsoft/dstoolkit-text2sql-and-imageprocessing/commits/v.0.1.0

Contributors