Notice: Function wp_enqueue_script was called incorrectly. Scripts and styles should not be registered or enqueued until the wp_enqueue_scripts, admin_enqueue_scripts, or login_enqueue_scripts hooks. This notice was triggered by the nfd_wpnavbar_setting handle. Please see Debugging in WordPress for more information. (This message was added in version 3.3.0.) in /home1/scottich/public_html/wp-includes/functions.php on line 6078

Deprecated: Function jetpack_form_register_pattern is deprecated since version jetpack-13.4! Use Automattic\Jetpack\Forms\ContactForm\Util::register_pattern instead. in /home1/scottich/public_html/wp-includes/functions.php on line 6078

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831

Warning: Cannot modify header information - headers already sent by (output started at /home1/scottich/public_html/wp-includes/functions.php:6078) in /home1/scottich/public_html/wp-includes/rest-api/class-wp-rest-server.php on line 1831
{"id":3301,"date":"2018-09-11T20:18:08","date_gmt":"2018-09-11T20:18:08","guid":{"rendered":"http:\/\/scottdimmich.com\/?p=3301"},"modified":"2018-09-11T20:18:08","modified_gmt":"2018-09-11T20:18:08","slug":"meteorologists-need-to-be-data-scientists-and-programmers-their-future-depends-on-it","status":"publish","type":"post","link":"https:\/\/scottdimmich.com\/2018\/09\/11\/meteorologists-need-to-be-data-scientists-and-programmers-their-future-depends-on-it\/","title":{"rendered":"Meteorologists Need To Be Data Scientists And Programmers. Their Future Depends On It."},"content":{"rendered":"

Data is really, really important to any business that matters. Data is being used to not just get a heartbeat on what customers are buying and using; it’s being used to drive decisions within the business. As I highlighted yesterday<\/a>, companies are spending large amount of money (and their profits!) to better understand their customers’ behavior and purchasing profile.<\/p>\n

Alternatively, meteorology requires quality data. Looking at surface, radar, satellite, and upper-level trends is a very valuable part of creating a forecast, but it will only take you so far…perhaps 12 hours into the future in some but not all situations. Computer guidance is needed to make forecasts that are longer-term. Knowing where severe storms will develop, where that hurricane will go, and how much snow will accumulate requires data and an understanding of it.<\/p>\n

Meteorology isn’t a rewarding science unless the results are shared with many; there is little value in knowing where a storm will go and what impact it will have if only you know what the forecast is. If emergency managers, state officials, and the public know where the tornado is moving and what impacts a city will get from a tropical system, the information is far more valuable and can be used to make and inform other decisions.<\/p>\n

Unfortunately, meteorologists can’t just download their analysis and knowledge into other people’s heads. The world would be a much smarter, better place (I hope) if we could freely exchange information and insight by installing it directly in a brain…but that isn’t the case. This requires a meteorologist to communicate their insights, conclusions, recommendations, and the data that supports all of these decisions. The conclusions, recommendations, and insights are valuable, but people and decision makers want to see the data for themselves to make sense of it.<\/em><\/p>\n

The best meteorologists I know use quality data to tell a quality story. <\/strong>With so many options to get a forecast, it’s important to stand out; this unique story requires unique data<\/em>. So why do so many meteorologists struggle with getting this unique<\/span> data?<\/strong><\/p>\n

I want to emphasize the word “unique” here. Radar data is everywhere. Satellite data is everywhere. Model data is everywhere. Forecasts are everywhere. I’ve seen the National Hurricane Center’s track of the hurricane, and odds are good most have, too. Basically, if all or most of the weather communicators have access to or use the information, it’s not unique and people have no reason or incentive to choose one source over another.<\/strong><\/p>\n

So let’s go back to the question: why do meteorologists struggle with getting unique<\/span><\/strong> data? As someone that knows a fair amount about statistics, data, computers, and weather…programming is difficult. To be a successful programmer, you – among other things – must know:<\/p>\n

    \n
  1. Where to get the data<\/li>\n
  2. How to scrape or gather the data<\/li>\n
  3. Format and quality control the data<\/li>\n
  4. Know the tools to process and analyze the data<\/li>\n
  5. Output the data or insights into a specific format<\/li>\n<\/ol>\n

    This process is not easy. There’s a lot weather data out there, and there are many meteorology-specific and non-meteorology-specific tools out there. These tools have a learning curve, and these tools take time to learn.<\/p>\n

    Secondly, finding the source of the data takes skill, time, and patience.<\/p>\n

    Let’s look at this problem. What does weather impact? How about rivers? Here’s a recent forecast for the Cape Fear River near Wilmington, South Carolina:<\/p>\n

    \"sep11-blog-rivers\"<\/p>\n

    This is a helpful plot of information. It shows past, current, and forecast observations with tide information embedded. As I write this blog, Hurricane Florence is nearing the Carolinas, so flooding and river flooding information is even more valuable. So if I’m in the weather communication world, how do I share this information with my customers? I could screengrab it and share it out, but my bosses may not be happy with NOAA’s brand all over that data.<\/p>\n

    On the page where I pulled this data<\/a>, there is an XML<\/a> and RSS<\/a> link to the underlying data in the plot above. Within the XML and RSS link, there are observed and forecast data points and corresponding times. We can download this raw data, process it, and export it to a weather communication computer system. So how do we get the data from where is it to where we want it? The answer is: figure it out! Don’t get defeated, don’t get overwhelmed, don’t get angry; instead, research:<\/strong><\/p>\n

      \n
    1. What programming languages read and process XML and RSS data<\/li>\n
    2. How to use those languages to write code and transform the input data into desired output data<\/li>\n
    3. The ways to automate the process.<\/li>\n<\/ol>\n

      Next, you have to take the output and use it as an input for your weather communication computer system. That’s where your knowledge of the latter gets used to finish the project and tell a unique weather story.<\/em><\/p>\n

      What else is impacted by weather? Power outages, air quality, river levels, road conditions, and more. Those who source the data (power companies, air quality agencies, etc.) typically publish their data in some form to the Internet. So how do you get that data from their final source to your final source? The answer is: figure it out! You can do this, but you have to have the passion, energy, and time to make it happen. <\/strong>It’s important to note that extra time to make a unique product today may save you a lot of time in the future.<\/em><\/p>\n

      Before you think that you can’t get information from that weather-related data website, you can<\/em>. If you can get it in a browser, you can<\/span> get the data. You just have to try harder to get it and transform it.<\/em><\/p>\n

      The ultimate goal here, as I alluded to in my blog post from yesterday<\/a>, is to create a sustainable competitive advantage and cross-promote your product. If you own product A and B, you tell people on Product A to get a unique forecast on Product B, and you tell people on Product B to get a unique forecast on Product A, you’re likely to keep your company happy while also giving your company value.<\/p>\n

      Need an example of this in action? Try this:<\/p>\n

      \n

      School Delay Hot Spot is ONLY on WTOL! A little patchy fog with a few delays possible. Latest on air now! pic.twitter.com\/P6ILlSb9TB<\/a><\/p>\n

      — Chris Vickers (@ChrisWTOL) September 11, 2018<\/a><\/p><\/blockquote>\n