From Data Warehouse to AI Engine: Leveraging Vector Search in Databricks Workflows