Wednesday, December 2, 2009

Post Allframe reflections

Back to updating.

So I now have files with super great astrometry and also proper sky levels. Using those, I DAOphot'd and allstar'd everything, throwing out bad pixels when calculating the psfs. My allstar files ended up having a few thousand stars a piece usually. After that, I prepared everything using DAOmatch and DAOmaster then Allframed it all.

I still don't quite understand how DAOmaster finds the number of stars that it does. For a typical input allstar file of a single exposure on a single chip with a few thousand, DAOMaster finds something like 25,000 stars when looking at all of the exposures on a chip (20 in all). I'm allowing daomaster to use all stars that are found on any one chip, and these numbers indicate to me that there could be double counting as if it makes a list (.mag file) of every star found on every chip regardless of whether it's already been found. But according to the ccdpck_man.doc (guinea pig documentation):

"Finally you specify a match-up radius. After having transformed the stars in frame n to the coordinate system of the master frame, stars will be cross-identified only if their positions agree to within that tolerance.
Furthermore, they will agree only if that is the closest otherwise unassigned star in frame n to that star in the master list, and only if that is the closest otherwise unassigned star in the
master list to that star in frame n. Multiple cross-identifications of the same star in one list to different stars in the other are not allowed.

DAOMASTER will go through all the star lists and match as many
stars as it can to stars appearing in the master list (initially equal to
the list of stars found in frame 1); many of these provisional
cross-identifications will be spurious, but legitimate cross-identifications
will outnumber them."

After allframing, I combine the two bands from a single chip and select out only those stars found in both. The result is a catalog of around 20,000 stars. The files that Ricardo Allframed for me over the summer tend to have something like 12,000 stars in the final catalog file of both bands.

While this is a little troubling, I'm willing to accept particularly because the astrometry was bad before. In creating the final file, stars must match up in both bands. With bad astrometry, it's likely that many of these stars got thrown out. Not all of them did because the astrometry was only about 4 or 5 pixels off, but it's somewhat reasonable that about half were too far off and didn't match up with any other stars so they don't end up in the final catalog. Also, the only files input to DAOmatch and DAOmaster were .als outputs which all contained a sane (few thousand) number of stars, as Ricardo confirmed. So the number of stars are coming from a sane source and I'm using the same parameters as Ricardo did (save for a correction to the transformation relevant to our data set).

2 of the chips are still Allframing. Once they're finished, I'll create the catalog for them and then I'll go about making a master list. With my master list I'll look into making cuts in chi and sharp and then move on to finishing calibrations.

Monday, September 21, 2009

In honor of my trip to Chile, I'm bringing back the blog posting, hopefully on a regular basis. More to come on the observing experience later. At the moment I have several tasks at hand in my own research that I'm behind on doing:

1. Finishing my talk and paper for the KNAC thing next weekend.
So far I have a draft of the talk power point, though it could use some work. I'm essentially using my Ann Arbor talk as a template, but I took out Alex's contributions since he'll have his own talk at KNAC and I added some background info. I'm (passively) looking for more figures to make the ppt more interesting.

2. Testing out the new supermongo install.
At this very moment I'm running Allframe on the g exposures of chip3. I'm still having some trouble with formatting issues of the output of DAOmatch that I feel like others don't have--it's necessary for me to delete columns before continuing on to DAOmaster. But so far after deleting some columns I'm up and running and Allframe has yet to crash AND it's not making crazy filenames! Having learned better, I'll wait to send the official report until I'm sure that it will finish without breaking.


 If it does work, I'm going to go back and see if I can figure out the discrepancy in outputs. Even if I can't, I already have code to reformat the files to what they should be so I'm going to continue with all of the chips to create a new master list to compare with the other. I'm going to use a different exposure to reference all of the other frames to because I was having problems on some of the chips with the exposure (126) that I chose last time. I think I might go with an r exposure this time, since I don't remember having any difficulties with those. 


3. Tracing back the RA and Dec of my star list to see if the astrometry could be off somewhere which now may be causing problems with calibration.
I've barely started on this but I'm going to focus more attention on it and hopefully have something figured out by the end of tonight.


4. Plot the magnitude offsets as a function of distance from the center of Willman 1 to check for a radial dependence which also could indicate problems with calibration.
I attempted this one but ran into some snags. I think there's definitely a lot more I can do after putting some more thought into it. Again, now that I'm settled in here I'll take some time during some of the longer exposures to do this--right after I've figured out the RA, Dec situation, which I think is more important at the moment.


All of this will definitely get checked off the list this week because it's already the end of September and I need to move on already.

Thursday, July 16, 2009

Positive Loglike Values!

Hallelujah.

Today:

I got the max likelihood code working with a fix to the KPNO input file. It's running at a snail's pace, though. The amoeba results look legit at first glance so I hope I'm not wasting time in letting it run.

Allframe finished last night, but I'm just noticing that all of my sharp values are 0.0. This is going to be a big problem when I go to make chi and sharp cuts to the CMD to pick out the stars. I'm looking into this and trying to run Allframe again to see if there's not an easy fix. I wasn't entirely sure what to change to fix this problem since it's so random, but I increased the Allframe iterations and I'll just see if my results are similar to what I got before.

In the meantime my post-Allframe analysis is so close and yet so far...I'm currently at a standstill with running DAOmaster on my Allframe output. For some reason it just won't read the input file. I tried the files that Ricardo sent from his run of Wil1 data and that won't run either. So I sent some of my files back to him to see if they'll run on his machine. I'm not sure if I'll be happy or not if they run there, but it'll be better than nothing. I compared my files to his and other than the sharp thing I don't see a difference. And I don't think the bad value would contribute to a read error. I'm going to take a fresh look at it a little later when I haven't been staring at the same files all day.


Tomorrow:

With any luck my max likelihood run will be done so I'll have some good Wil1 params by the end of the day.

With a huge amount of luck it won't take me another 2 weeks to figure out what's wrong with the Allframe analysis this time. Ricardo got good sharp values on the same data so I'm not sure I want to know what the problem is...but one way or another it would be awesome to have a CMD leading into the weekend. If only the allframe results would cooperate. The rest is really pretty straightforward.

In the meantime of other things running I'm going to get started on the absolute magnitude calculation. With everything else happening I doubt this will get done by the end of tomorrow. But I'll settle for by the end of Monday.


Results are finally close to coming together. I just hope it happens sooner rather than later so I can put this talk together.

Wednesday, July 15, 2009

Allframe works!

Today:

Got allframe working! Finally.

Compared a density plot I made of my star list with one made from the original catalog. I'm inclined to say that the one I made with the original catalog matches figure Beth sent that she made back using that catalog. But there are still significant morphological differences between my distribution from the new catalog and these other figures. This concerns me.

I also have an idea about what could be causing ridiculousness in my input file...I think it's most likely something wrong with the input file. I don't have enough time to implement some changes at the moment but I'm going to come back to this tonight and try a revised input file.

Tomorrow:
1. I want to close the loop on this stellar density plot. Hopefully I'll have Allframe results to work with.
2. Allframe will be done running, so I'll need to figure out how to put together my master list and then create a CMD.
3. Go back to working on the max likelihood stuff. I got caught up with Allframe so I'm still having many of the same issues as before. I'm wondering if I didn't quite implement Dave's corrections correctly. Something is wrong and it's probably going to take a careful eye to catch it. It would be great if I could have it running by Friday so I can be sure to have some solid results to put into my talk.

Monday, July 13, 2009

Today:

I Double checked the chi and sharp cuts I made:

I ended up using:
--sharp: -0.5 to 0.5
--chi: 0.8 to 1.5
This is more or less a generous cut to clean things up a bit. More could be done to get a more stringent cut. I also remade the CMD with these cuts and without getting close to Wil1. It looks pretty good. I noticed that the isochrone wasn't doing a good job of describing the data and realized that I must have used the wrong distance to Wil1 when I calculated the distance modulus. But that's fixed and all is well. I used the same code Anna and I wrote for Segue to match stars to within 1 sigma of the M92 isochrone. I also made a Hess Diagram which I've been playing with, but also looks really good.


I also set out to tweak the contour plot of stellar density:

Like I just mentioned, I did a better job of selecting the stars for the CMD and used only the stars that matched the chi/sharp and isochrone cuts but didn't do any ra/dec cuts so that I would have the whole field to work with. I messed with Beth's annulus idea only to realize that I was already scaling the smoothed density plot. But I wasn't ignoring the central region (where Wil1 is). So I made a mask that cut out the central square before I scaled things. It was a crude way of doing it and could be changed, but I think it'll do for now. My contours definitely turned out looking a lot better so I think I'm going to tweak the smoothing and binning tonight to see if I can't get it looking really good by tomorrow.


So, in all, I now have newly updated figures from KPNO data including: hess diagram, CMD with isochrone fit, chi and sharp cuts, stellar density plot.


Tomorrow:

Max likelihood for KPNO
-still dealign with negative loglikes?
-got an email from Dave--he thinks I might have to get fancy like he did with LBT. He also pointed out some other stuff in his code that might be useful to change. I'm gonna look into this more tomorrow and probably talk to him about it.

Absolute Magnitude
Beth's been thinking a lot about how to calculate this and gave me a pretty good way of going about it. I wanted to finish what I was already working on, but this is on the plate for tomorrow.
-LF
-plots and normalization
-final calculations
-mag limit from 2006--90% completion

Friday, July 10, 2009

And then there were spatial density plots.

Tuesday, July 7, 2009

Super fast update because I have to go pick up the chilluns:


Allframe still doesn't work.

Got the max likelihood code working (thanks to Dave) on the SDSS data.

Almost ready to run the max likelihood code on the KPNO data--want to double check my input first.

In lieu of Allframe results, the next step with my stack is artificial star testing, right Beth? Will look at addstar tomorrow.

Also tomorrow: look more closely at max likelihood results, run the code on KPNO stars, commence the testing of artificial stars.