flat-file Questions

6

I have an SSIS package using a tab delimited flat file source with a TON of fields. Recently the provider of the tab delimited flat file has decided to change the format of the flat file by sprinkl...
Clouded asked 4/6, 2009 at 12:57

6

Solved

I have an SSIS package with a Data Flow that takes an ADO.NET data source (just a small table), executes a select * query, and outputs the query results to a flat file (I've also tried just pulling...
Align asked 19/5, 2010 at 18:41

3

Solved

There are few questions related to this topic on stackoverflow, But I didn't get the proper answer. I have some doubts on performance of flat files, Is it better to use flat files instead of SQLite...
Aylsworth asked 31/8, 2012 at 9:33

9

Solved

I got only these 2 errors when converting flat files to database tables. The dataflow seems to work for other flat files with the same layout so I don't understand where these errors could come fro...
Johen asked 23/4, 2014 at 2:7

6

Solved

Have a pretty straight forward SSIS package: OLE DB Source to get data via a view, (all string columns in db table nvarchar or nchar). Derived Column to format existing date and add it on to the ...
Rally asked 16/3, 2011 at 8:26

7

Solved

I have an SSIS package thats unzips and loads a text file. It has been working great from the debugger, and from the various servers its been uploaded to on its way to our production environment. M...
Honk asked 1/2, 2013 at 18:45

5

Solved

using SSIS 2012. My flat file connection manager I have a delimited file where the row delimiter is set to CRLF, but when it processes the file, I have a text column that has an LF in it. This is c...
Gentilis asked 24/5, 2017 at 16:58

13

Solved

If I have a static database consisting of folders and files, would access and manipulation be faster than SQL server type databases, considering this would be used in a CGI script? When work...
Craunch asked 27/1, 2010 at 15:4

8

Solved

I have a series of ASCII flat files coming in from a mainframe to be processed by a C# application. A new feed has been introduced with a Packed Decimal (COMP-3) field, which needs to be converted ...
Makepeace asked 27/9, 2008 at 4:18

3

In a text file, lines are detected by \n at the end of each line. For this purpose, it is necessary to read the entire file, and this is a big problem for large files (say 2GB). I am looking for a ...
Cherianne asked 10/10, 2011 at 7:55

2

Solved

I don't know too much about SSIS and I've googled as much as I could on this. I'd really appreciate any help I could get. I'm building an SSIS package and I only want to insert a specific set of d...
Registered asked 19/1, 2011 at 15:20

2

I am trying to load data from text files to database. My source files contain null character NUL somehow (Picture1). I just make all the fields as one column (delimited with {CR}{LF}). Then I d...
Unscramble asked 27/6, 2013 at 7:36

3

I'm exporting a table output to a CSV file. I'm doing it using SSIS package which has OLE DB Source and Flat File Destination. I'm getting the following errors: [Flat File Destination [2]] Error: ...
Yser asked 14/5, 2018 at 20:55

2

Solved

Every day a PPE.txt file with clients data, separated by semicolon and always with the same layout is stored to a specific file directory. Every day someone has to update a specific table from our...
Lindon asked 26/3, 2019 at 22:5

2

Solved

I have the below within the Data-flow area. The problem I'm experiencing is that even if the result is 0, it is still creating the file. Can anyone see what I'm doing wrong here?
Irrepressible asked 10/2, 2019 at 5:40

3

Solved

Our client sends us a flat file as input, which we then take and convert to an XML file before sending to the destination system. The flat file consists of multiple lines, each line is delimited b...
Taverner asked 22/4, 2010 at 15:28

3

I need to create a database using a CSV file with SSIS. The CSV file includes four columns: I need to use the information of that table to populate the three tables I created in SQL below. I ha...
Fitzsimmons asked 2/12, 2016 at 18:13

6

I am getting the null values while loading the data from flat files into hive tables. my tables structure is like this: hive> create table test_hive (id int,value string); and my flat file is...
Cascarilla asked 14/11, 2012 at 12:59

3

Solved

I have to import about 50 different types of files every day. Some of them with a few columns, some inculde up to 250 columns. The Flat File connection always defaults all columns to 50 chars. So...
Pragmatic asked 7/7, 2017 at 7:19

1

Solved

In SSIS, I try to load data from a flat file. The flat file have fixed width columns, but some column are not present in a row (a column can have a CRLF, which must be a new line) like this a b c ...
Hazel asked 29/5, 2017 at 15:13

2

Solved

I was just wondering what people's thoughts were on reading from Hive vs reading from a .csv file or a .txt file or an .ORC file, or a .parquet file. Assuming the underlying Hive table is an extern...
Gine asked 22/5, 2017 at 18:53

1

There are a lot of examples which use FlatFileItemReader along with TaskExecutor. I provide samples below (both with XML and Java Config): Using Oracle Coherence with Spring Batch Spring Batch Mu...
Idolater asked 16/2, 2017 at 10:10

6

Solved

I have to create a CSV file from webservice output and the CSV file uses quoted strings with comma separator. I cannot change the format... So if I have a string it becomes a "string"... If the va...
Darceydarci asked 16/6, 2011 at 19:29

3

Solved

I am trying to import data from a utf-8 encoded flat file into SQL Server 2008 using SSIS. This is what the end of the row data looks like in Notepad++: I have a couple more images showing what ...
Biotope asked 7/6, 2011 at 16:4

9

Solved

Is there any framework/library to help writing fixed length flat files in java? I want to write a collection of beans/entities into a flat file without worrying with convertions, padding, alignmen...
Caseose asked 4/5, 2011 at 14:31

© 2022 - 2024 — McMap. All rights reserved.