https://github.com/veksh/q_unload

dump oracle SQL query result to CSV, fast
https://github.com/veksh/q_unload

csv export oracle

Last synced: 11 months ago
JSON representation

dump oracle SQL query result to CSV, fast

• Host: GitHub
• URL: https://github.com/veksh/q_unload
• Owner: veksh
• Created: 2017-01-31T19:29:32.000Z (about 9 years ago)
• Default Branch: master
• Last Pushed: 2021-09-21T10:34:21.000Z (over 4 years ago)
• Last Synced: 2025-03-31T18:08:18.119Z (12 months ago)
• Topics: csv, export, oracle
• Language: C
• Size: 63.5 KB
• Stars: 10
• Watchers: 3
• Forks: 4
• Open Issues: 0
• Metadata Files:
  • Readme: Readme.markdown

Awesome Lists containing this project

README

          
# Description

Simple program to dump query results to text files, based on some fork of Tom Kyte 

original [array-flat][kyte-flat] utility. Usually runs 10 times faster than dumping

CSV with hand-crafted query from sql*plus, upto 100 times faster in extreme cases

like unloading large XML CLOBs in UTF8.

[kyte-flat]: https://asktom.oracle.com/pls/asktom/f?p=100:11:0::::P11_QUESTION_ID:459020243348

# Changes and added features

- Makefile to automate build, fixes for current Oracle version (tested on 11.2)

- user password is not printed to stderr

- options for 

    - null replacement string

    - newline replacement char

    - forced cursor sharing

- ablity to change fields separator

- optionally enclosing strings and escaping delimitier inside strings

- reading query from file

- setting dbms_application_info for long-running queries

- ability to work with CLOB fields with configurable maximum size (default 65K)

# Usage

- basic

        ./q2csv userid=user/$pass@server sqlstmt='select * from gestori.katalog where rownum < 10'  

        ./q2csv userid=user/$pass@server sqlfile=query.sql enclosure='"' replace_nl=' ' share=y > t.dat

        ./q2csv userid=user/$pass@server sqlfile=query.sql enclosure='"' encl_esc='"' \

           cli_info='uid="batch", host="here"' \ 

           mod_info='ges SPb, proc="load-table-mail"' \

           act_info='get-prog ora-ges.p'

- options

    - `userid`: credentials in `user/pass` format; pass with env var

    - `sqlstmt`: query to execute (for inline)

    - `sqlfile`: query file name (for saved)

    - `delimiter`: field separator, default "|"

    - `enclosure`: enclosing quotes for string fields, default: none

    - `encl_esc`: escape char for enclosing quotes inside string fields, default: none

    - `replace_null`: null replacement string, default "?"

    - `null_string`: empty (null) string replacement, default "" (empty)

    - `replace_nl`: newline replacement char, default: keep newlines

    - `share`: if not empty, enable forced cursor sharing for session

    - `arraysize`: fetch array size, default 10 records; set to 2-3 with large CLOBs

    - `cli_info`, `mod_info`, `act_info`: client, module and action for `dbms_application_info`

    - `max_clob`: maximum CLOB size, default 65K

    - `headers`: if not empty, add field names as CSV header

- obscure options, specific for our environment

    - `pnull_string`: if string field equals hard-coded PRONULL string (currently "<$null4mail_ora$>"),

      replace its contents with this string (usually "?") to facilitate Progress replication

- to fine-tune date presentation: export env vars like

        export NLS_LANG=AMERICAN_CIS.UTF8

        export NLS_DATE_FORMAT='DD.MM.RR'

        export NLS_TIMESTAMP_FORMAT='YYYY-MM-DD"T"HH24:MI:SS.FF6'

- to prevent an application from hanging on SIGABRT (e.g. glibc "double free") errors: disable

  [OCI signal handler][oci-faults] in `$TNS_ADMIN/sqlnet.ora`

        DIAG_SIGHANDLER_ENABLED=FALSE

[oci-faults]: https://docs.oracle.com/cd/E18283_01/appdev.112/e10646/oci10new.htm#CHDCIAHJ