Acronym
c/s = CubeSat
Meeting minutes at NASA GSFC
Presented the mission (see slides) and discussed in particular with Gene C. Feldman, Susanne Craig and Ivona Ceticic. Overall good support from the audience (30-40 people) for this mission and how we want to operate, good questions & discussions. In their perspective, the “rapid response” idea in a multi-agent architecture is what makes this hyperspectral imaging concept/mission great, not the hyperspectral camera only. We should leverage more the idea what we want to do with UAVS, AUVS and USVs to respond to dedicated downlinked data from HYPSO (whether those are full raw images, spectral signatures and target coordinates).
Discussions after my presentation:
- Should we do a Balloon test? Absolutely! Would increase TRL of payload considerably if it works. Almost no difference between Top of Atmosphere (ToA) radiance vs. radiance at 100,000 ft. Essential to understand what we will see in space.
- How will we deal with clouds?
- We should make a historical database on weather reports (identify cloudy days; fully covered; partially covered) at different geographic locations in Norway to map where probability of observable conditions are highest.
- MeteoSat, European GEO satellite, uses cloud product for a region on a daily basis, gives more reliability of where to point for our c/s.
- Its spatial coverage is 4 km.
- (mission operations once launched) Look for where there are small enough patches to look at in almost real-time.
- Create a cloud screening algorithm, include an atmospheric variables.
- PACE – a representative working on that mission asked what are spectral responses we are looking for at each wavelength/band. Is it the water-leaving spectral shape or the radiance that we want to reconstruct? Operational vs. scientific? Spectral shape algorithms – are they good enough (ref. Rick Strumpff's@NOAA methods)? Compare different algorithms and methods.
Discussions with Gene C. Feldman:
- L1a data should be downlinked at minimum, NOT L0 (useless with ancillary data). Cannot reconstruct L0 and L1a (or it is difficult) from L1b, since it is normalized to sensor units (takes away raw data) – since we then use sensor calibration (sensor stability factors) to process to L1b. Gene is not happy with ESA giving L1b products since they are difficult to reconstruct. L2 does not make sense when chl-a conc. isn't appropriately correlated to ToA radiance. Radiometric calibration, geometric calibration and atmospheric correction need to be applied L1b->L2. Huge dataset for L1a, so need to consider that for downlink (he suggests X-band, maturity today is high).
- For L1b data do we want to recalibrate the sensor per imaging, or let it stay as it is until really necessary? L1a dataset will change based on the recalibration. Essence with L1a is to characterize the image based and understand degradation of optics, FoV coefficients etc. With recalibration we cannot figure that out.
- Things move after launch and in each operations, that's why we also need L1a at all times to see how the sensor+image data changes with time.
- Ground truth is really bad for in-situ validation: instantaneous sampling on ground and remote imaging from space won’t happen.
- Why? Ground point-to-point in-situ validation is not reasonable since it is difficult to map this to the pixels on the sensor and also this does not give any information about how the whole image should be calibrated/corrected. Sampling across large area can give you a better clue but difficult to do. You can’t take a point and sample it and say hey this is how the water looks like at that point. Water is way more heterogeneous than you think from point to point.
- Doing it across a e.g. 30x30 km grid makes sense though impossible to do operationally/physically. Things change very quickly over the course of the imaging operations and imaging on fine scale and sampling. We can't get a coherent structure in that way. Radiance values vary too much across pixels and where you take images. Need many many assets out there to get a better idea but will never be perfect. Algal blooms and ocean in general are too dynamic and highly varying – esp. wrt. currents and waves.
- Apply deconvolution and super-resolution between L1b and L2: Correct. Minimum success criteria is to do super-resolution on ground, don't risk doing it onboard (at least in the first season of operations).
- Slew maneuver ambitious to achieve perfect GSD as proposed. Baseline should be to point Nadir, have 500 m spatial in-track resolution and view a 50 km line for 8 seconds. Slewing shall be full success criteria, we don't know the precision.
- Our theoretical SNR is ok, but need to find out what it is in practice. Good that we redesigned from V4 to V6!
- Hawkeye mission: Gene is working on this mission. They are using X-band for downlink and has deployable antennas. Suggestions:
- S-band is ok, “touch the water before jumping into it” and since we will have a S-band ground station at NTNU and may want to also downlink there. But it really doesn’t matter in terms of real-time to downlink "fast", data will be distributed quickly and use S-band Ground Station across the globe.
- TRL for X-band is high enough today to downlink higher amount of data – send a lot more data in shorter time – save energy and operations complexity. Think about it for next mission.
- Use a RGB camera to geo-reference the HSI FoV instantaneously and on image grid. Hawkeye uses FinderScope (a RGB camera - same principle).
- Skepticism on HSI, esp. on the spectral binning branch. Increase SNR thru more binning and get less spectral resolution which would already be great at 20 nm-40 nm.
- Processing in SeaDas would be great. Ensure format is readable.
- Downlink to NASA GSFC is not necessary - they can download from our website/server.
Ajit’s feedback on presentation:
- State clearly the advantages and disadvantages with c/s vs. conventional satellites if we are to propose that cubesats are "so great". They will never replace bigger satellites but on the other hand give smaller complementary data.
- Mission success criteria shall be stated clearly and formulated better. Distinguish what is minimum and what is full. Draw CONOPS for both (e.g. 1) no slew, downlink raw data, no complex uplink; 2) slew, downlink processed data, more complex uplink, using robotic agents.
- Make a slide with minimum vs. full success criteria. What are the quantitative tresholds? Baseline threshold matrix in systems eng.-how they do it at NASA GSFC.
- Images with binning is still considered raw data? What is minimum and full success? 1x binning minimum, 10x binning is full success. Differentiate between high-res mode, medium-res mode and low-res mode. Gain=0 always for raw data, but applying binning on raw data is up for discussion.
- The idea of rapid response in robotic platform architecture is great. Leverage that for future missions we want to downlink spectral signatures directly to robotic agents (UAV or ASV). Thus, SDR sounds like a very good option where modulation and tuning of frequency happens both on satellite and ground assets. This allows even more rapid response for the the vehicles on surface to analyze the spectral signatures and give feedback to satellite through uplink (inter-calibration). Also target coordinates can be sent down directly to the ground assets for corrections in planning and maneuvering towards the target area and where there are interesting signatures to detect. This would save cost and time for the robotic assets considerably. For first-flight we don’t need think about it but reveal the plan for this for future missions (2nd possible?).
- Check with Raphe on field validating/match up with HICO. Curt Davis collaborated on that, who was the PI on HICO. He is uncertain if there has been any field campaign to match the HICO data?
- What again is the need for hyperspectral? We can do the multispectral with less amount of data and much higher SNR. Ours basically works as a MSI, because we select the specific reference bands? But we are not able to bin it? And our SNR could be much higher in general, so would be better to use a MSI and have higher efficiency. MSI has higher SNR at those reference bands for example. HSI basically is a trade-off for flexibility giving low SNR. We compromise SNR too much with HSI.
Ivona Ceticic & Susanne Craig (more TBD on this as I am discussing with them on email)
- Coordinate collaboration with Croatia through Ivona Cetinic.
- She suggests we could use ground stations in Croatia and perform imaging in the Adriatic Sea. She also suggested to send someone from NTNU to the workshop/conference: https://oceanopticsconference.org/.
- We should map S-band ground stations around the world that we may use.
- Ivona: dynamics of phytoplankton is very important to monitor. Image the same target over several passes and days, perform ToA radiance day to day measurements and see the increase in ToA radiance – does it increase with higher chl-a concentrations from day to day, hour to hour? What happens when there is 12 mg/m3 vs 1 mg/m3 chl-a concentration, dissipating or increasing concentrations lead to difference in ToA radiance? Calculate the gradient of the spectral shape against time.
- Should we recalibrate sensor between each pass? Or not touch?
- Email: ivona.cetinic@nasa.gov . Web: https://science.gsfc.nasa.gov/sed/bio/ivona.cetinic
- Susanne Craig talks about atmospheric correction for hyperspectral imaging: there are “cheating” ways to correct the atmospheric problem instead of using the standard atmospheric correction techniques – since it is very hard and unpredictable from scene to scene. But never stay fixed to one method - explore and compare (even while in flight).
- Email: susanne.e.craig@nasa.gov. She knows Geir Johnsen very well!
- Some publications to check:
- Werdell, P.J., McKinna, L.I.W., Boss, E., Ackleson, S.G., Craig, S.E., Gregg, W.W., Lee, Z., Maritorena, S., Roesler, C.S., Rousseaux, C.S., Stramski, D., Sullivan, J.M., Twardowski, M.S., Tzortziou, M. and Zhang, X. (2018). An Overview of Approaches and Challenges for Retrieving Marine Inherent Optical Properties from Ocean Color Remote Sensing, Prog. Oceanogr., 160, 186-212, doi:10.1016/j.pocean.2018.01.001 . (IMPORTANT)
- Craig, S.E., Lohrenz, S.E., Lee, Z.P., Mahoney, K.L., Kirkpatrick, G.J., Schofield, O.M., and Steward, R.G. (2006). Use of Hyperspectral Remote Sensing for the Detection and Assessment of the Harmful Algae, Karenia Brevis, Appl. Opt., 45(21), 5414-5425, doi: 10.1364/AO.45.005414. (IMPORTANT)
- McKee, D., Cunningham, A., and Craig, S.E. (2003). Semi-Empirical Correction Algorithm for AC-9 Measurements in a Coccolithophore Bloom, Appl. Opt., 42(21), 4369-4374, doi: 10.1364/AO.42.004369.
- McKee, D., Cunningham, A., and Craig, S.E. (2003). Estimation of Absorption and Backscattering Coefficients from In Situ Radiometric Measurements: Theory and Validation in Case II Waters, Appl. Opt., 42(15), 2804-2810, doi: 10.1364/AO.42.002804
Main outcomes:
- Downlink L1a data as baseline raw data, not L0 or L1b.
- Do most data processing on ground. E.g. L1a->L1b->L2 on ground.
- Each frame needs all ancillary data (altitude, camera settings, attitude, viewing angle, sun angle etc.)
- Radiometric processing onboard is too ambitious and will probably not work/give a lot of errors, wisest is to do it on ground
- It is advised that also geometric processing (geo-referencing etc.) should be done on ground with reference grid
- Use wide FoV RGB camera for validation and georeferencing
- Separate clearly minimum and full success criteria
- Make an objective to monitor same target area and biological matter over time, see how spectral response changes wrt chl-a concentrations
- Don't avoid atmospheric correction, we could use methods such as spectral shape identification (ref. Rick Strumpff's operational methods) and ground truth etc. but compare the results don't just go for one.
- Don't rely on ground truth for space remote sensing.
- Do ballon test.
- Develop and use cloud screening algorithm (based on MeteoSat weather data).
- We should talk more with Ivona Cetinic and Susanne Craig. They have good ideas what to do in radiometric processing chain and how to interpret the data.
- Gene C. Feldman has offered to give guidance and inputs.
- Distribute data to GSFC when we get results - they can give some inputs to analysis and how to visualize it in SeaDas - but only for L1a data. Not interested in highly processed data.
- Check papers:
- Werdell, P.J., McKinna, L.I.W., Boss, E., Ackleson, S.G., Craig, S.E., Gregg, W.W., Lee, Z., Maritorena, S., Roesler, C.S., Rousseaux, C.S., Stramski, D., Sullivan, J.M., Twardowski, M.S., Tzortziou, M. and Zhang, X. (2018). An Overview of Approaches and Challenges for Retrieving Marine Inherent Optical Properties from Ocean Color Remote Sensing, Prog. Oceanogr., 160, 186-212, doi:10.1016/j.pocean.2018.01.001.
- Craig, S.E., Lohrenz, S.E., Lee, Z.P., Mahoney, K.L., Kirkpatrick, G.J., Schofield, O.M., and Steward, R.G. (2006). Use of Hyperspectral Remote Sensing for the Detection and Assessment of the Harmful Algae, Karenia Brevis, Appl. Opt., 45(21), 5414-5425, doi: 10.1364/AO.45.005414.