Adv1: LSM, Subversion, Bugzilla, etc.

1

LSM: The Local Sky Model 







A Solution: The LSM

All scripts up till now had essentially “hard-wired” sky sources within the script body itself, usually expressed in lm coordinates. This is convenient for testing and simulation of instrumental effects, but not convenient at all when we want to simulate a “real” field. Also, we'd sometimes like to make “one size fits all” scripts, where different source models are simply swapped in. Source structure encoded in the tree, so decisions need to be taken at compile time.

Adv1: LSM, Subversion, Bugzilla, etc.

 









3

 



For LOFAR, we're developing a Global Sky Model (GSM), containing all known radio sources (to some depth...) This will be a huge database. To calibrate a specific observation, we then extract an LSM by selecting a subset of the GSM for that specific field of view, plus the brightest sources in the far sidelobes. LOFAR will incorporate a source extraction and GSM update cycle.

Demo follows... (Adv1/demo1-lsm.py) The LSM is a database of sources for a specific field of view. Can be generated from existing catalogues (NVSS in this example). Main body of code (Timba/LSM) is indepent of rest of system, as it may also be used by the LOFAR KSGs for, e.g., source extraction. A simple loop (Adv1/lsm_model.py) reads an LSM at turns it into a list of Meow components. Source type is encoded in the LSM.

4

Adv1: LSM, Subversion, Bugzilla, etc.

LSM & LOFAR 

2

Adv1: LSM, Subversion, Bugzilla, etc.

LSM Future 

 



LSM to be redesigned in the near future, as the current codebase shows “growth rings”. Will not affect the basic principles. Will add seamless support for shapelets, patch images, etc. – need a vocabulary of “source categories”, for which corresponding Meow component classes will be provided. Underlying DB will change (and change and change), but this should not affect the TDL interface.

Adv1: LSM, Subversion, Bugzilla, etc.

5

Adv1: LSM, Subversion, Bugzilla, etc.

Inburgering Cursus: A subversion primer

LSM & SKA Simulations  

Can be an suitable format for exchanging “SKA Skies” Has a number of advantages over plain images: – frequency dependence is naturally represented (as, e.g., spectral indices, incl. variable spectral indices), without resorting to hi-res frequency cubes. – same for time dependence. – accurate morphologies for extended sources, using patch images, shapelets, or plain Gaussians. – better trade off btw. spatial resolution and data size. – can be directly plugged into a MeqTree, no need to decompose image into sources. – can be easily decomposed into subsets (e.g. by flux, source type, etc.)

Adv1: LSM, Subversion, Bugzilla, etc.



The subversion repository is on

–  



7





Anonymous access is read-only To contribute changes/scripts, an account on lofar9 is required. To check out anonymously: svn checkout svn://lofar9.astron.nl/.... (see path above)



Only need to do this the first time.

most “svn” commands compatible some important differences w.r.t. tagging, branching, and “sticky” state.

Please see “The Subversion Book” (online). You need to use svn to keep an up-to-date version of Timba. Currently requires firewall holes into lofar9.

Adv1: LSM, Subversion, Bugzilla, etc.

A subversion primer, 3 

lofar9.astron.nl/var/svn/repos/trunk/Timba (“trunk” refers to main version). 

subversion is a version control system, basically an improvement on CVS –

A subversion primer, 2 

6

To check out with r/w access: svn checkout svn+ssh://lofar9.astron.nl/.... (see path above)





This will ask for your lofar9 password (if username on lofar9 is different, supply via --username option). You may configure ssh to let you in w/o a password, by putting your public key on lofar9 and using ssh-add.

8

Adv1: LSM, Subversion, Bugzilla, etc.

9

Adv1: LSM, Subversion, Bugzilla, etc.

A subversion primer, 3 

A subversion primer, 4

To check out with r/w access:



svn checkout svn+ssh://lofar9.astron.nl/.... (see path above) 



Commiting Code Changes For Dummies 

No such thing: –







If you don't know how to commit code, you probably shouldn't be doing it.

Before you commit, at least skim the Subversion Book, and be careful your changes don't break other things. Obvious bugfixes are encouraged, but any nontrivial changes ought to be discussed with the code author. That said...

Once you have checked out, updating to the latest version is easy: cd ~/Timba svn up

This will ask for your lofar9 password (if username on lofar9 is different, supply via --username option). You may configure ssh to let you in w/o a password, by putting your public key on lofar9 and using ssh-add.

Adv1: LSM, Subversion, Bugzilla, etc.

10





11

svn “remembers” --username, repository path, etc. Will ask for your lofar9 password each time, unless you do the public key thing.

Adv1: LSM, Subversion, Bugzilla, etc.

The Watering Hole!

12

Adv1: LSM, Subversion, Bugzilla, etc.

13

Adv1: LSM, Subversion, Bugzilla, etc.

...Another View Of a Watering Hole...

14

The Watering Hole! 



The Watering Hole is a place for everybody to play and share scripts, etc. Your own corner of the WH is called: Timba/WH/contrib/XYZ (XYZ = your initials)



You may commit anything Timba-related, within reason: – –

Adv1: LSM, Subversion, Bugzilla, etc.

15

Adv1: LSM, Subversion, Bugzilla, etc.

Building The System  

Walk-through follows... The whole process is documented on the Timba Wiki: http://lofar9.astron.nl/meqwiki (see the BuildingTimba pages)



If you see any inaccuracies in the Wiki, please feel free to correct, that's what a Wiki is for.

scripts, documentation, presentations NO large data files please, NO MSs

Reporting Bugs 

Use our Bugzilla system to report bugs and file enhancement requests



You can create yourself a Bugzilla account on the front page, Bugs reports submitted via conversation in the corridors have a half-life of 27.3 minutes before they vanish from the average developer's mental stack. USE Bugzilla and win valuable prizes!

http://lofar9.astron.nl/bugzilla



16

17

Adv1: LSM, Subversion, Bugzilla, etc.

The Wiki

Bugzilla  



http://lofar9.astron.nl/meqwiki

Bugzilla walk-through follows... Do a quick Bugzilla search before reporting (you may find something interesting, e.g. a known workaround). But don't waste too much time, we'd rather deal with duplicate reports (which are eventually merged anyway) than having bugs go unreported.

 





19

Adv1: LSM, Subversion, Bugzilla, etc.





Announcements, any questions, discussion. Good to follow it if you become an active user, as things like “current svn version is broken, please don't update until I fix it” are broadcast via the list. To sign up, send an e-mail with “subscribe” in the subject or body to: [email protected]

Source of all documentation, news, etc. Feel free to sign up and correct pages or edit your own, the structuring is minimal. You're free to place any relevant material of your own. Your personal pages (accessed via YourName) are a handy way to keep a “logbook”.

Adv1: LSM, Subversion, Bugzilla, etc.

Weekly Videocon:

Mailing List 

18

Adv1: LSM, Subversion, Bugzilla, etc.

If you just simply miss us too much 

 

Really dedicated users can join in the videocon. Every Wednesday at 15:30 Dwingeloo time. Jan posts the program to the mailing list.

20

LSM: The Local Sky Model A Solution: The LSM LSM ... - GitHub

o contribute changes/scripts, an account on lofar9 is required. ... ou can create yourself a Bugzilla account on the front ... average developer's mental stack. USE.

124KB Sizes 5 Downloads 154 Views

Recommend Documents

DATA LSM 2013.pdf
Tgl. 25 Oktober 2013. Pertanian. Page 5 of 7. DATA LSM 2013.pdf. DATA LSM 2013.pdf. Open. Extract. Open with. Sign In. Main menu. Displaying DATA LSM ...

Evidence for Two Activation Mechanisms in LSM SOFC ...
electrode film limits performance by forcing an unfavorable bulk path for oxygen ion transport from the surface incorporation site to the LSM/electrolyte interface. This is particularly apparent at zero bias due to the low ionic conductivity of LSM;

Implementing the Local Sky Model in the MeqTree System - GitHub
Date of issue: 2005-Jul-08. Scope: Project Documentation. Kind of issue: Public ... System Engineering Manager. Program Manager. J.E. Noordam. C.M. de Vos.

The Planning Solution in a Textbook Model of ... - Semantic Scholar
Feb 23, 2004 - This note uses recursive methods to provide a simple characterization of the planner's solution of the continuous time and discrete time version of the simplest Pissarides (2000) model. I show that the solutions are virtually identical

The local Solow growth model
By local, we refer to the idea that a Solow model applies to each country, ... F G. , the analogous savings rate for human capital, and the log of (n. G##), where n.

Alarm clock - model A - GitHub
ALARM ON-OFF. 5.797. 3.495. USB HOST. ETHERNET ... Alarm Clock. TITLE. Final assembly (Model A) ..... ARM System-On-Module. 1. 3. DM3AT-SF-PEJM5.

The Full-Sky ME The Full-Sky ME Image-plane vs. -plane - GitHub
terms of your “domain language”: I have an interferometer array of antennas make me a point source here make me the nodes to compute visibilities at each.

Poptato – A Micro-Service Solution - GitHub
associations of the movie. This includes cast, director & Oscar awards management. All entities & relation are exposed via ... Our web client is written in HTML5, JavaScript ES2017 & CSS3. We're using Polymer which is a JavaScript library that helps

Solution Requirements and Guidelines - GitHub
Jan 14, 2014 - will be specific to J2EE web application architectures, these requirements ... of other common web technologies a foundation for developing an Anti-‐CSRF solution with .... http://keyczar.googlecode.com/files/keyczar05b.pdf.

spatial model - GitHub
Real survey data is messy ... Weather has a big effect on detectability. Need to record during survey. Disambiguate ... Parallel processing. Some models are very ...

Solution for the Search Results Relevance Challenge - GitHub
Jul 17, 2015 - They call such method as semi-supervised learning. ... 2. calculate the pdf/cdf of each median relevance level, 1 is about 7.6%, 1 + 2 is ..... Systems: Proceedings of the 2011 Conference (NIPS '11), pages 2546–2554, 2011.

MymixApp domain model - GitHub
MymixApp domain model. Mixtape about string dedication string img_src string ... title string. User avatar string dj_name string email string password_digest string.

ELib domain model - GitHub
ELib domain model. Book description text isbn string (13) ∗ mb_image_url string (512) pc_image_url string (512) title string (255) ∗. BookCase evaluation ...

Model AIC Deviance - GitHub
summary(dsm_all). Family: Tweedie(p=1.25). Link function: log. Formula: count ~ s(x, y) + s(Depth) + s(DistToCAS) + s(SST) + s(EKE) + s(NPP) + offset(off.set).

Cameraphile domain model - GitHub
Cameraphile domain model. Camera asin string brand string large_image_url string lcd_screen_size string megapixels string memory_type string model string.

Alarm clock - model B - GitHub
ALARM ON-OFF. 5.797. 3.495. USB HOST. ETHERNET ... Alarm Clock. TITLE. Final assembly (Model B) ..... ARM System-On-Module. 1. 3. DM3AT-SF-PEJM5.

Dell | Cloudera Solution User's Guide - GitHub
Oct 3, 2013 - Figure 5: License Key Confirmation Screen . .... Figure 18: Cluster Services Initialization Screen . .... Local Area Network on Motherboard. NIC.

Reverse Engineering the FRB/US Model in R - GitHub
Jun 25, 2016 - 2.1.10 a.10 ECNIAN . ...... 1The pdf was created with noweb, the literate programming tool: ”noweb ... plan to morph it into the R software environment for statistical ...... 2.9.30 i.30 RCAR: New car loan rate at finance companies.

Overview Local Builds and Modifications - GitHub
The first stage is part of the asic and loads the Secondary Program Loader. (SPL) into the asic's ... git checkout --track -b lsi-v2013.01.01 origin/lsi-v2013.01.01. 1 ...