Just looking to source some data from a Redshift instance, there was no specific Redshift integration, so I tried selecting a Postgres DB. I configured everything, but during validation the script failed:
2020-10-07 04:38:29,641Z tap - INFO Running DB discovery: SELECT datname
2020-10-07 04:38:29,641Z tap - FROM pg_database
2020-10-07 04:38:29,641Z tap - WHERE datistemplate = false
2020-10-07 04:38:29,641Z tap - AND datname != ‘rdsadmin’ with itersize 20000
2020-10-07 04:38:30,435Z tap - CRITICAL Fetch ALL is not supported on single-node clusters. Please specify the fetch size (maximum 1000 for single-node clusters) or upgrade to a multi node installation.
The SQL is valid and works, so the error appears to be in the way the python driver is configured.
What should I do about this ?