Skip to content

Exclude database views from table catalog - #135

Merged
YanivZalach merged 4 commits into
masterfrom
t3code/placeholder-pr-branch
Aug 15, 2026
Merged

Exclude database views from table catalog#135
YanivZalach merged 4 commits into
masterfrom
t3code/placeholder-pr-branch

Conversation

@YanivZalach

@YanivZalach YanivZalach commented Aug 15, 2026

Copy link
Copy Markdown
Owner

Closes #103

Summary

  • Add get_database_views_df() to retrieve views from each database via Spark SQL
  • Filter views from table listings using DataFrame subtract()
  • Simplify temporary table filtering by moving it earlier in the pipeline
  • Combine table and view filtering for cleaner final output

Refactor table filtering to exclude views alongside temporary tables
Comment thread backend/table_list_catalog/utils.py Outdated
Catch PySparkException instead of every exception and log the error reason.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@YanivZalach

Copy link
Copy Markdown
Owner Author

Addressed: get_database_views_df now catches PySparkException (covers AnalysisException and SparkConnectGrpcException) instead of every exception, and the warning log includes the error reason: Could not list views in {database}: {error}.

Yaniv Zalach and others added 2 commits August 15, 2026 18:02
Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Temporary views share the tables namespace, so a temp view named after a
permanent table would drop that table from the catalog listing.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
@YanivZalach
YanivZalach requested a review from Razberrry August 15, 2026 15:19
@YanivZalach
YanivZalach merged commit aa27237 into master Aug 15, 2026
2 checks passed
@YanivZalach
YanivZalach deleted the t3code/placeholder-pr-branch branch August 15, 2026 22:42
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Catalog showing views

2 participants