2 Building on @camo's answer, since you're looking to use the secret value outside Databricks, you can use the Databricks Python SDK to fetch the bytes representation of the secret value, then decode and print locally (or on any compute resource outside of Databricks).
It's not possible, Databricks just scans entire output for occurences of secret values and replaces them with " [REDACTED]". It is helpless if you transform the value. For example, like you tried already, you could insert spaces between characters and that would reveal the value. You can use a trick with an invisible character - for example Unicode invisible separator, which is encoded as ...
Databricks demands the use of the IDENTIFIER () clause when using widgets to reference objects including tables, fields, etc., which is exactly what you're doing.
Is there a way to use parameters in Databricks in SQL with parameter ...
Update: April 2023rd. There is a for querying Databricks SQL tables via REST API. It's possible to use Databricks for that, although it heavily dependent on the SLAs - how fast should be response. Answering your questions in order: There is no standalone API for execution of queries and getting back results (yet). But you can create a thin wrapper using one of the drivers to work with ...
0 You can connect your on-premises SQL Server to Databricks using the JDBC driver available in Databricks Runtime. Below are the high-level steps to establish this connection: Steps to Connect Azure Databricks to an On-Premises SQL Server Set up a Transit Virtual Network (VNet) with an Azure Virtual Network Gateway.