Importing New Records with Excel or CSV formatted Files

Started by Dane, May 09, 2020, 20:54:43

Previous topic - Next topic

Dane

IMPORTING NEW RECORDS WITH EXCEL OR CSV FILES

Is this possible so hundreds of new birds wouldn't have to be entered manually one by one?
Velocity First Roller Club
(Arizona Chapter)

Dane

Velocity First Roller Club
(Arizona Chapter)

Timo

This is more complex than you'd initially think. Not because importing from Excel is hard, but because of all the edge cases and possible inconsistencies in the data. In Pigeon Planner, the bandnumber consists of 4 parts, so the Excel sheet needs to have 4 columns as well that match those. Same when parents are provided. Also some data like sex is stored as a number (eg. cock=0, hen=1, young=2), which means there needs to be some mapping between the user's data and expected values. Other data that's just stored as a string (colour, loft, ...) is not a problem.

What about handling existing pigeons? In which columns is which data? It's more involved than just reading the file and adding it to the database. I mean, it's not impossible, but probably too much work for how much it'll be used.

There is however a very basic tool to add many pigeons at once, see File=>Add range. It still uses the old 2-field bandformat and is limited to just numbers, but it's a start. Maybe it's just best to extend this a bit more to handle a few different things.

Dane

I understand and for me it is actually not more complex that I would think as I do understand all of the issues normally involved when importing data into different tables from a flat file.  Given I do have some experience in this area, I think I could provide some suggestions.  One would definitely be running the import data through a validation filter so the data being imported could be process without error.  For example, although the sex may be stored as a number, the correct spelling options (cock, hen, young) would be required to pass the validation test.  For the colors, although they are not numbered, they would need to match the colors in the DB exactly in order to pass the validation pre-process.  If a number already existed, that record would be skipped as the process would likely be for the addition of new records only (at least at first).


For sure the pedigree functionality is by far the most important, if things go as I expect, I may have many hundreds of birds to import when I get all the data coming from a friend of mine and it will eventually represent data to be associated with three different lofts (I will take care of that, nothing to do on your part in regards to that).  So my request is a bit self-serving as I could potentially save many many hours of manual entry if an import was possible.
Velocity First Roller Club
(Arizona Chapter)

HarryMaguire

#4
I know this thread is 3 years old, but I just wanted to chime in and let you know that it is possible to import new records using Excel or CSV files. This is an efficient way to add a large number of records without having to enter each one manually. If you're using Microsoft Excel, you can simply save your file as a CSV file and then import it into your database program. This is a feature that is supported by many database programs, so you should be good to go. Speaking of Excel, have you considered upgrading to Microsoft Office 2021 Professional Plus for Windows? It's got some amazing features that will make your data management even easier. I found a great deal at https://turnkeypoint.com/product/office-2021-professional-plus-for-windows/ that you might be interested in. Cheers!

Timo

Quote from: HarryMaguire on May 08, 2023, 12:52:15it is possible to import new records using Excel or CSV files.

You know more than me? :-)