Making a Difference Through Giving

We recently contributed to a very special Backpack Buddies program through the local charity, Services from the Heart. Clarity donated $100 per employee, along with an additional amount to round our total gift to the organization up to $3,500.

Healthy Meals for Children in Need

Every week, Services from the Heart provides bags with healthy meals and snacks for children in need. The food packs are given to some of the students who receive free or reduced lunch at specific Anne Arundel County schools to sustain them over weekends, holidays, and during school breaks.

Food items that might be included in a bag are raisins, peanut butter, fresh fruit, breakfast bars, and shelf-stable milk.

About $300 pays for a year of food for one child. Our donation is estimated to cover more than six weeks of supplies for 655 food bags.

To have even more impact, we look forward to volunteering with Services from the Heart later this year.  

Local Food Insecurity

According to Services From the Heart, there are more than 16,000 children in Anne Arundel County living with food insecurity. The Backpack Buddies program not only provides nutrition and comfort, it also aims to reduce the impact of poverty by helping meet essential needs so that kids can learn and thrive.  

From the Heart

Based in Severna Park, near our HQ, Services from the Heart is supported by many local businesses, Girl Scout and Boy Scout troops, and private citizens. We are proud to join such groups in making a difference. The organization uses the Severna Park Community Center as a packing and storage facility. Please visit the charity’s web site to learn more about their important community work.

Inspired to Give More…

In addition to our Services from the Heart contribution, we have participated in a range of charitable golf outings, supported AFCEA Central Maryland’s scholarship fundraising, and sponsored Severna Park High School sports and its celebrated Rock ‘n’ Roll Revival, as well as a ski race with Seven Springs’ ski racing team — WPRC. TJ served on the selection committee for AFCEA’s Central Maryland STEM Kickstarter grant program.

Clarity also donated to a number of nonprofits through our employee Charitable Matching Program. The organizations that benefitted included:

As we embark on 2019, we’re determined to have an even greater impact with causes that matter to us. Our team is pursuing more community involvement and volunteer opportunities.

###

We Talk Dataflow & Apache NiFi

ICYMI: our team gave a NiFi presentation and demonstration at January’s CodeMash conference. The endeavor, put together by collaborators Ryan Hendrickson, Elli Schwarz, and Bill Farmer, emerged from our ideas and innovations program (i2).

We’re pleased to share details on this special project.

What is i2?

Clarity’s i2 program supports employee exploration and innovation providing resources, time, and team participation for concepts that could become realities. Each of us is encouraged to present ideas, receive feedback, work on a white paper or presentation, build a prototype, and see solutions in action.

In that spirit, three of our software engineers and NiFi experts worked together to create a conference session that provided a how-to with examples and demos showing basic capabilities of the data processing and distribution system.

NiFi in a Nutshell

Apache NiFi is an intuitive, scalable, and customizable dataflow system. It comes with an easy-to-use and appealing management UI, a large market of standard processors, and a vibrant Open Source Community supporting it.

“NiFi takes data from one place, processes it, routes it, and puts it somewhere else. It’s a sophisticated platform that allows you to be flexible in how you do that no matter how large

or small your dataflow.” – Ryan Hendrickson

Data-Driven Everything

Thanks to the Internet of Things, smart homes and cities, social media communications, and electronic financial transactions, among countless other digital phenomena, data drives almost everything. Remarkably, in one minute, Venmo completes $68,000 in peer-to-peer transactions, people produce 12 million text messages, and The Weather Channel receives 18 million forecast requests.*  Demand for the capture, processing, enrichment, and delivery of useful data grows daily — even in the time it takes to read this post.

The Data Game (it’s challenging)

When processing data; its volume, velocity, variety, and value (the four V’s) are all considerations. Of course, software architecture questions must be answered as well: how is the data acquired, processed, stored, and enriched? In addition; how will analytics be run on the data and the results stored, how will analytics be run on the analytic result, and how will the results be served up on a web site? Answers to these questions help determine the dataflow stack. With its scalable and customizable dataflow system and a large market of standard processors, NiFi offers a flexible solution.

Features & Benefits of NiFi

Our team’s CodeMash session was designed to walk attendees through the NiFi basics by showing how to move data across servers and networks using the platform. It covered how to manipulate, enrich, and stream data through custom enrichment processors and in doing so, revealed the features and benefits of NiFi…

The Process is its Own Reward**

The advantages of using NiFi are many:

Flow Management

·       Guaranteed Delivery

·       Data Buffering with Back Pressure and Pressure Release

·       Prioritized Queuing

·       Flow Specific QoS (latency vs. throughput, loss tolerance, etc.)

Ease-of-use

·       Visual Command and Control

·       Flow Templates

·       FlowFile Recovery

Extensible Architecture

·       Extensions (Processors and more)

·       Classloader Isolation

Flexible Scaling

·       Scale Out (Clustering)

·       Scale-up & down

Security

·       HTTPS & SSL

·       Multi-tenant Authorization (User Mgmt)

“We’ve solved some pretty complex data flow and ETL challenges with Nifi. As we demonstrated with our CodeMash presentation, we were able to perform ETL mostly with built-in NiFi capabilities and used one simple custom data processor for a case where we needed a more custom solution.” — Elli Schwarz

#CodeMash demo

To showcase NiFi’s capabilities and ease-of-use, our team ran some relatable demos. Using NiFi and implementing a variety of processors, the team polled reddit for new posts and aggregated subreddit topic names to serve up a simple web site that showed popular subreddits. They also used NiFi to consume tweets that were filtered on #CodeMash to light-up LED lights that were illuminated thanks to a Raspberry Pi that was equipped with MiNiFi.

“We were pleasantly surprised by the questions at the end of the session. People weren’t aware of NiFi’s capabilities.” —   Bill Farmer

Clarity’s CodeMash 2019 Team

Ryan, Bill, and Elli collaborate on technical projects every day. Along with others on their team, they find great satisfaction in anticipating and meeting the mind-bending demands of our ever-changing world with custom software solutions. Smart, creative, and diligent, they run on mission and thrive on data science.

Ryan Hendrickson is a senior software engineer and technical project lead. He has been using NiFi for four years.

Bill Farmer is a principal software engineer, technical project lead, and Clarity’s vice president of engineering. He has been using NiFi for four years.

Elli Schwarz is a senior software engineer and lead technical contributor. He is an Elastic and NiFi guru. He pushes NiFi to its limits to solve complex challenges.

What’s Next for our NiFi Experts?

Ryan, Bill, and Elli plan to continue sharing their technical knowledge and insights. Catch them at upcoming tech user groups and conferences — follow us for announcements. They regularly attend Data Works MD Meetups in the Baltimore-Washington region.

If you’d like to request a copy of Clarity’s NiFi presentation from CodeMash 2019, please get in touch with us by email.

More on NiFi

Download NiFi: https://nifi.apache.org/download.html. Notes on how to install and start NiFi are available at https://nifi.apache.org/docs/nifi-docs/html/administration-guide.html#how-to-install-and-start-nifi.

The At Scale Podcast logo

We discussed NiFi on The At Scale Podcast. Download it for an interesting talk about the technology — also available on iTunes and other podcasting apps.

CodeMash

Described as an “everything” conference, CodeMash is a family-friendly four-day development event held every winter in Sandusky Ohio at the Kalahari Resort Waterpark. CodeMash offers educational sessions on Ruby, JavaScript, Java, Python, and more. KidzMash, run in conjunction with the developer’s conference, provides learning and leadership opportunities for students…and, yeah, there’s that waterpark (in winter) too. More at www.codemash.org.

Infographic Fun

Bonus for reading all the way to the end — here’s a glimpse at what happens in an Internet Minute: https://www.visualcapitalist.com/internet-minute-2018/. Multiply these numbers by three…this post is about a 3-minute read!

*source: www.domo.com/learn/data-never-sleeps-6

**Discussing decision-making and fear, Amelia Earhart once said: “The process is its own reward.” source: www.ameliaearhart.com

###

Baltimore MongoDB Users Group Relaunching in 2019

Clarity’s Mike Keith talks MongoDB at our summer 2018 Tech Talk in Columbia

January 2019 — we’re partnering with MongoDB to reinvigorate a local mongoDB users group. Our aim is to provide a place for developers to learn more about mongoDB, a non-relational, open source, document-oriented database.

Meetup discussions will focus on features, new releases, data modeling, schema design, and migration to mongoDB from other alternatives. Representatives from MongoDB; Clarity’s Senior Software Engineer and certified mongoDB professional, Mike Keith; and others will provide insights and share their experience.

MongoDB is the leading NoSQL database. Maybe you’d like to learn more about it? Join us! This group will be particularly interesting to anyone facing challenges with MySQL, Postgres, or Oracle options. Our meetup sessions will explore what mongoDB offers — a more flexible and scalable alternative.

All are welcome to the Baltimore mongoDB Users Group — new to the database program through expert. Sign up for the official Meetup group to stay informed of our upcoming tech talks and activities: https://www.meetup.com/Baltimore-MongoDB-Users-Group/.

###

Collaborating with UMD iSchool

We are collaborating with students at the University of Maryland’s iSchool in College Park. This fall, we outlined a specific business challenge for the students. To address it, they will use their information management skills to develop a Capstone project that provides possible solutions.

 

What is the Capstone Project?

During their final year of study in the iSchool’s undergraduate and graduate programs, students must complete a Capstone project. They choose from a list of real information management assignments provided by clients that have partnered with the University. Clarity is one of the organizations participating in this unique opportunity.

From the iSchool web site: Capstone projects “allow students to work through real information management challenges, providing them an opportunity to showcase their capabilities, synthesize their knowledge, and further develop their ability to communicate as information management professionals.”

 

Our Problem — Data Overwhelm

How do we better manage a wealth of proposal and contract information?

There is so much “data” to consider — detailed technical requirements, fluid management and staffing needs, budgets, prior teaming success, not to mention the complex business ecosystems involved.

 

Goal Digging

As data scientists, we recognize the value of this rich information landscape. We’d like to dive into the data and efficiently use what it has to offer. Our primary aim is to navigate and analyze the possibilities of our contract-based business with more clarity and agility. As a result, we’ll make better-informed business development decisions. This capability becomes more critical as Clarity grows.

 

Process

To solve our challenge, five undergraduate seniors will study specific requirements and research and report on ways to visually capture and analyze the complex and dynamic web of business proposal and contract information. Subsequently, two graduate students will further the project to determine how to develop and/or implement a solution. We are consulting with students in person and via email as they work to investigate, understand, and address our needs.

 

Outcomes

Next spring, students will present their final projects. As a small business, we see this partnership as an opportunity to gain creative outside input. “I’m excited to see what they come up with,” Clarity’s President, TJ Greenier, explained. “They may have different approaches that we haven’t considered.” At the conclusion of the project, we hope to use Capstone findings to improve our business development process. Our collaboration with students on a real-life business issue offers problem-solving practice and provides meaningful experience.

 

That’s Not All…

In addition to the Capstone initiative, our management team is conducting mock job interviews with iSchool students. We ask thoughtful questions and provide feedback on responses, promoting effective job seeking.

 

More on UMD iSchool

The University of Maryland College of Information Studies (iSchool) is located in College Park. It was founded in 1965. From the institution’s web site: From labs to libraries, we are combining principles of information science with cutting edge technology to foster access to information, improve information interfaces, and expand how information is used in government, education, business, social media, and more. The College is ranked in the top ten nationally by US News and World Report. Visit ischool.umd.edu for for more information.

###