×

INDI Library v2.0.7 is Released (01 Apr 2024)

Bi-monthly release with minor bug fixes and improvements

New astro imaging catalog software. Help testing needed

  • Posts: 535
  • Thank you received: 109
It was just missing some spaces, then works:
#!/bin/bash
cd $(dirname "$0")
source ./venv/bin/activate
if [ -d "./venv/lib/python3.6" ]
then
cd ./venv/lib/python3.6/site-packages/
elif [ -d "./venv/lib/python3.7" ]
then
cd ./venv/lib/python3.7/site-packages/
elif [ -d "./venv/lib/python3.8" ]
then
cd ./venv/lib/python3.8/site-packages/
else
echo "python not found"
exit 0
fi
export QT_SCALE_FACTOR=1
python3 -m astrodom
deactivate
The following user(s) said Thank You: Ferrante Enriques
3 years 11 months ago #54061

Please Log in or Create an account to join the conversation.

  • Posts: 398
  • Thank you received: 117
A few initial impressions. REALLY nice! Thanks for doing this. Here's some suggestions to consider:
a. in the import fits tab, is unique hash really needed by the user (or can it just be a hidden field)?
b. import fits tab: To save GUI real-estate, I suggest shortening some names: Targ, Frame, Exp, Cam Temp, Site Lat, Site Lon. Idea is GUI space is precious...
c. Images tab: Same idea to shorten names as on import, but also: Eccen, SNR Wt
d. There are a few fields missing that I think we'll want in the future (when Ekos is ready...not yet, but hopefully in the future): Env Temp, Foc HFR, Seeing.
I'm not sure when these extra fields might get added, and it might be a pain to edit to add in the meantime, but could be very useful to have in the archive. Something to think about....
Finally, I think having screen resize capability would be highly desired. I can't seem to figure out how to resize (or it's not there)?

I'll play some more and give more feedback.... In the meantime, this is a fun tool to explore!
The following user(s) said Thank You: Ferrante Enriques
3 years 11 months ago #54063

Please Log in or Create an account to join the conversation.

  • Posts: 249
  • Thank you received: 62
Thank you! any advice is appreciated.

It can be a hidden field. but it is also the one used to highlight errors if the imported file is already existing in the database. You have the same message in the log window but here is more in the context.

I use AstroDom on a wide display...BUT if you want you can customize those name, they are stored in a json file: /venv/lib/python3.x/site-packages/astrodom/config/profile-EkosIndi.json
just change the 'description' values.
I suggest that you save (in Settings) a new custom profile to have a working backup and to avoid conflict when upgrading AstroDom. Tell me if you succeed in doing this.

Same as above

Exactly! I build it with the idea to expand the fields in the future The keyword list is almost dynamically loaded.

It's my first QT application....if someone could explain how to resize windows I will be very happy to implement it.

3 years 11 months ago #54066

Please Log in or Create an account to join the conversation.

  • Posts: 398
  • Thank you received: 117
I did succeed in changing those field names. Sufficient enough. A few more comments:
- The filename and Date fields should probably have slightly wider defaults. The Ekos date field is clipping. Easy enough to adjust, but with a larger default, it wouldn't.
- It would be very nice if any user adjusted field sizes were remembered. I know....it's easy enough to do each session. The user experience across sessions would be better. This should go for the import tab fields too.
- The last field of the import tab doesn't work as nicely as the last field of the images tab. You can't grab / downsize that last field to desired width so the header stays with the data.
- longer term, should you consider having the last field for "Comments" on the images tab? That might find use by some users...
- About that hash field, I recommend calling that "Status". Save the hash value internally and give a "Ready", or "Ready to Import" value until successfully imported?
- In settings, should the "hide" selector operate on both import tab and image tab fields? I realize that if hidden, it could cause confusion if any hidden import field wasn't right, but seems this could be overcome by a message. Just a thought.

Edit - a couple more (I think I'm done now):
- Recommend sexagesimal (hours) format for RA. Dec too (degs). It's pretty ubiquitous in the amateur community. I know astronomers get used to degrees for both, but....
- also, need a way to delete rows from the DB (image tab).
Last edit: 3 years 11 months ago by Doug S.
3 years 11 months ago #54072

Please Log in or Create an account to join the conversation.

  • Posts: 398
  • Thank you received: 117
I'm having problems importing Pixinsight CSV files. I'm also having a few core dumps. The main app seems to work ok to import image files, but when I attempt to import/associate the csv stats from Pixinsight's subframe selector, the app reads the CSV file ok, but complains it can't find the fits files to associate the data to (even though all fits have already been successfully imported to the DB and show up on the images tab). Looking at the terminal output as the app runs and sometimes cores (I've seen a "cancel" operation core a couple of times), I see these lines:

apparently non-fatal lines:
======================
QGridLayoutEngine::addItem: Cell (3, 1) already taken (often many lines repeated)

AstroDom-master/resources/venv/lib/python3.8/site-packages/numpy/core/fromnumeric.py:3334: RuntimeWarning: Mean of empty slice.
return _methods._mean(a, axis=axis, dtype=dtype,
AstroDom-master/resources/venv/lib/python3.8/site-packages/numpy/core/_methods.py:161: RuntimeWarning: invalid value encountered in double_scalars
ret = ret.dtype.type(ret / rcount)
AstroDom-master/resources/venv/lib/python3.8/site-packages/numpy/core/_methods.py:216: RuntimeWarning: Degrees of freedom <= 0 for slice
ret = _var(a, axis=axis, dtype=dtype, out=out, ddof=ddof,
AstroDom-master/resources/venv/lib/python3.8/site-packages/numpy/core/_methods.py:185: RuntimeWarning: invalid value encountered in true_divide
arrmean = um.true_divide(
AstroDom-master/resources/venv/lib/python3.8/site-packages/numpy/core/_methods.py:209: RuntimeWarning: invalid value encountered in double_scalars
ret = ret.dtype.type(ret / rcount)

Fatal lines:
==========
Traceback (most recent call last):
File "archive/AstroDom-master/resources/venv/lib/python3.8/site-packages/astrodom/mainWindow.py", line 279, in dialogChart
self.chartWindow.plot(self.imageListModel)
File "archive/AstroDom-master/resources/venv/lib/python3.8/site-packages/astrodom/chartWindow.py", line 184, in plot
self.lrDate = pg.LinearRegionItem([min(timestampObj), max(timestampObj)])
ValueError: min() arg is an empty sequence
./astrodom_linux_run.sh: line 6: 242224 Aborted (core dumped) python3 -m astrodom

Another Fatal (different run-time instance):
====================================
Traceback (most recent call last):
File "archive/AstroDom-master/resources/venv/lib/python3.8/site-packages/astrodom/importCsvTab.py", line 67, in importCsvFile
for row, val in enumerate(dataTemp):
UnboundLocalError: local variable 'dataTemp' referenced before assignment
./astrodom_linux_run.sh: line 6: 242696 Aborted (core dumped) python3 -m astrodom

Not sure what I'm doing wrong or if there's a Python 3.8 incompatibility....I think I followed flow as per the youtube video. Let me know if you'd like additional info to chase......
3 years 11 months ago #54076

Please Log in or Create an account to join the conversation.

Wow this is really exciting! Looking forward to using it on my data!
The following user(s) said Thank You: Ferrante Enriques
3 years 11 months ago #54079

Please Log in or Create an account to join the conversation.

  • Posts: 249
  • Thank you received: 62
hi Doug,
I will test it with python 3.8 too as there are many people using that version.

Can you send me the CSV file you're trying to import?

Are you using the CSV file exported from PI SFS on your original FITS files (the ones you imported in Astrodom) or the .xisf file that are we usually export during the calibration process?
If it's the latter, AstroDom won't be able to work because there are no standard library to read data from .xisf files.

But reading your email better, you are able to read the content, AD complains about not finding the matching FITS file. Could it be that you moved the files after exporting the CSV? or in some way you altered the original FITS file?
To help you debug this is how AD works :
- when importing FITS file AD stores a hash of the files itself. That's more reliable than the filename as unique key in the database.
- when importing CSV it looks for the file name stored in the CSV file (and the file must exist in that path), try to open it and calculate a hash. Then look in the database for that hash / key.
- if a hash key is found, it can update the corresponding record.

I just hope the issue is not related to different PI versions because it will be hard to keep track of that.

Error output seems to be related to charts that are not reading all the values: could it be the CSV or the date format.
To better debug, can you also send me your database? it's the .db file in /venv/lib/python3.8/site-packages/astrodom/config/

ferrante
3 years 11 months ago #54081

Please Log in or Create an account to join the conversation.

  • Posts: 249
  • Thank you received: 62
Ok, I'll try to find a better approach to define the size of the window, table and columns. Have to learn how it works.
That's definitely useful, added to the todo list.
ok, it makes it more understandable.
My idea is to force to read all fields. It could generate a lot of confusion if some are hidden.I'm used to read sexagesimals too but decimals are mandatory for filtering and ordering columns in the table. But the way QT works separates the view from the model, so it could be possible to apply filtering/ordering on the underlying data (decimal) and present sexagesimals to the view.Ok
Cheers,
ferrante


Below the todo list based also on your input:
- Fix layout: window resize, save application layout (column width)
- ImportFits/ImportCsv: rename hash field 'Status'
- Image detail: add 'comments' field with notes about the image
- ImageList: sexagesimal and hour angle format for ra, dec, alt, az,obs lat, obs long in the table view.
- ImageDetails: image info (WCS, grid) and controls (pan, zoom, stretch)
- Import: Match fits file using filename (not just using hash).Mmmh no.
- Charts: Moon path in Alt/Az or Alt/Time charts (observatory issue)
- Charts: Custom x/y axis in charts
- Charts: Night vs night comparison
- Charts: Model updates graphs
- Charts: Linear fit, sigmas
- Charts: Hover info
- Image list: Delete / Edit rows
- Image list: Export data as csv
- INDI listner / Kstars DBUS
- Input validation
3 years 11 months ago #54083

Please Log in or Create an account to join the conversation.

  • Posts: 398
  • Thank you received: 117
Hi fenriques,

I'll send you separately the CSV and DB info (early hint....I didn't move or alter the FITS files). I'm sure we'll sort this out.

A couple notes on your "to do" list:
- - ImageList: sexagesimal and hour angle format for ra, dec, alt, az,obs lat, obs long in the table view.
(recommend sexagesimal only for ra,dec, maybe lat,lon, but NOT az,el).

-- Charts: Linear fit, sigmas
(Users will want 2nd and 3rd order poly if you provide linear. Beyond 3rd order is unnecessary)

not listed: Precision. Would be nice to have a precision settings value. Most folks may not want 6 digits. Often 2 is plenty. If you fix 2 however, they'll want 4 (hence a setting!).

cheers, Doug
3 years 11 months ago #54096

Please Log in or Create an account to join the conversation.

  • Posts: 398
  • Thank you received: 117
Ok, I think I might know what's going wrong with the CSV import. Pixinsight is running on a windows host. AD runs from a Linux guest within VirtualBox. There is a shared filesystem between these two hosts (windows owns the disk). Linux maps a mount point to the windows drive. The windows side (Pixinsight) knows the directory as C:\Users\dsummers\Astro\Images\M3:

Here's one of the CSV lines showing the filename:
1,true,false,"C:/Users/dsummers/Astro/Images/M3/M_3_Light_001.fits",0.00000,2.76138,0.60201,0.77116,520.00000,56.07616,63.85677,0.97686,392,0.07981,0.27846,0.04923,0.08623

The linux side knows this same directory as:
/home/dsummers/AstroImages/M3 (note: AstroImages on linux vs Astro/Images on PC)

These are the same disk location. So, I think this must be part of the issue. I can import the files because the AD GUI internals likely map the mountpoint correctly, but is the hash or program somehow confused by mount point naming convention differences between the PC and Linux?
Hmm....what to do? If the only confusion is "Astro/Images" vs "AstroImages", I could correct this by changing the mount point in Linux to more closely match the PC. If it extends to "Users/dsummers", vs "home/dsummers", it's a bigger issue.
Last edit: 3 years 11 months ago by Doug S. Reason: clarity
3 years 11 months ago #54099

Please Log in or Create an account to join the conversation.

  • Posts: 249
  • Thank you received: 62
hi Doug,
design a resizable layouts using QT designer was a nightmare, at least to me. But I ended up with something usable. and resizable.
Precision was something easy to add even though Ekos exports coord data with just 3 digit precision, so it useless to increase precision on those data.
Moreover I will go for the sexagesimal / hour / deg visualization so precision is just needed in the database.

ferrante

3 years 11 months ago #54102

Please Log in or Create an account to join the conversation.

  • Posts: 249
  • Thank you received: 62
AD tries to open (from your Linux VM) the file located at C:/Users/dsummers/Astro/...../.fits as written in the CSV file.
That's the only issue. Even if you mount with the exact same name I think it's the C:/Users that breaks up AD.

You could run AD from Windows? seems to be an easy solution.

3 years 11 months ago #54103

Please Log in or Create an account to join the conversation.

Time to create page: 0.352 seconds