Showing posts with label Android. Show all posts
Showing posts with label Android. Show all posts

Wednesday, March 16, 2022

Introduction to OCR and Google Cloud Vision

What is OCR

        OCR (Optical Character Recognition) is the use of technology to recognize printed or handwritten text characters in digital images of physical documents, such as scanned paper documents.

        The image is converted to a duotone image (ie black and white). Analyze the bright and dark areas of the image
Dark area = character to be recognized
Bright area = background



OCR works by Pattern recognition and feature detection 
Pattern recognition
  • Techniques that try to match characters with the character matrix stored in the database 
  • Rely on the input characters are consistent fonts, such as OCR A and B
Feature detection
  • More sophisticated identification methods 
  • Break down characters into "features" such as lines, loops, and intersections
OCR Application
  • Passport scanning, ID detect
  • Scan document
  • Automated data entry, extraction and processing
  • Receipt and Invoice Scanning
  • Electrical Medical Records
  • Forms and Surveys
  • Bank : Electronic document processing (checks, etc.)
  • ANPR / Traffic : Read vehicle license plate/VIN number
  • Logistics: Sort the mail.

Introduction to Artificial Intelligence (AI) and Machine Learning

Google Cloud Vision

    Cloud Vision allows developers to easily integrate vision detection features within applications, including image labeling, face and landmark detection, optical character recognition (OCR), and tagging of explicit content.













Google Cloud – Natural Language Processing (NLP)


Source : Google Cloud Vision
Share:

Monday, November 23, 2020

Introduction to AR Core

What is AR (Augmented Reality)

  • Blend real world in to the digital world
  • Integrate virtual content with the real world as seen through phone's camera
ARCore is Google’s platform for building augmented reality experiences
 


What is Google’s Tango Project (Prior to AR Core)
        ARCore has its origins in Tango, which is/was a more advanced AR toolkit that used special sensors built into consumer mobile device.
        Google’s (Peanut phone , Yellow Stone tablet) , Intel’s Real sense Smart phone , Lenovo Phab -2 , Asus Zen phone are equipped  with special sensors
        Later Google stopped Tango project as ARCore is evolved with less dependent on sensors as compared to Tango

Hardware of Phone used by ARCore

  • Fundamental concepts behind ARCore
  • Motion tracking
  • Feature points (through camera) + Motion sensors (through IMU: Accelero , Gyro)
  • Point , PointCloud , Pose are some of the classes exposed by ARCore SDK we can see how  user's position is tracked in relation to the feature points identified on the real couch.


  • Environmental understanding 
  • Uses technique called meshing 
  • Cluster of feature points used and returned as planes to applications along with each plane’s boundary

How does AR Core works

AR Core fundamentally does two things

    1Motion Tracking
        Building it’s own understanding of real world (Environmental understanding , Light Estimation , Orientation points , Anchors , Trackables

    2. Environmental limitations
        For now, limitations that may hinder accurate understanding of surfaces include:

  • Flat surfaces without texture, such as a white desk
  • Environments with dim lighting
  • Extremely bright environments
  • Transparent or reflective surfaces like glass
  • Dynamic or moving surfaces, such as blades of grass or ripples in water
        When users encounter environmental limitations, indicate what went wrong and point them in the right direction.   

            AR application that has identified a real-world surface through meshing. The plane is identified by the white dots. In the background, we can see how the user has already placed various virtual objects on the surface.


Light estimation

        Average intensity and color correction of a given camera image
Scene of realism is increased by applying the same light condition to virtual objects LightEstimate , LightEstimate.State are some of the classes used to get lightning condition User Interaction , Orientation points , Anchors and Trackables.
        Takes an (x,y) coordinate corresponding to the phone's screen
Projects ray into camera’s view of the real world
        Returns Plane/feature points that the ray intersects and Pose (kind of OpenGL model matrices) of that intersection in world space
HitResult , Pose , Anchor (fixed location and orientation of real world) are some of the classes provided by ARCore in this context
Trackable (interface) is something that ARCore can track and that Anchors can be attached to 

Note: 
        Because ARCore uses clusters of feature points to detect the surface's angle, surfaces without texture, such as a white wall, may not be detected properly.
        To reduce CPU costs, reuse anchors when possible and detach anchors that you no longer need.


Books on ARCore

Did you find our blog helpful ? Share in comment section. Feel free to share on Twitter or Facebook by using the share buttons

Share:

Android A11 features

                       

             Android 11 introduces great new features and APIs for developers. Android 11 focus more on People-centric and expressive, with a new controls space and more privacy features.
            Extend your apps with conversation notifications and bubbles, try one-time permissions, surface devices and media in the controls. Work faster with tools like compatibility toggles, ADB incremental installs, and more!


Lets look into Android 11 features

Conversation notifications

                There are now three notification categories: Conversations, Alerting, and Silent. The Conversations section, quite obviously, houses all your conversations. This would mean any app where you are directly communicating with someone else, including text messages and chat apps.     

            Meanwhile, the Alerting and Silent sections act as they have before in Android 10. You can also easily silence notifications from certain apps, which would push all future notifications to the Silent section. With Android 11, you now have more control over notifications than you ever had previously.

Notification history

            In Android 11! A new feature gives you the option of saving every single notification that landed on your phone over the past 24 hours. You can check the running list, find the notification you accidentally swiped, and see what you missed.

Related: Here’s a list of Android 11 phones

Chat bubbles in Android 11

             For all chat applications Android, you already know how chat bubbles work. With Messenger, a “chat head” appears on your phone that overlays on top of pretty much every other app. A quick tap of the icon launches the chat and then you can minimize the chat back to an icon. Done with the conversation? You can remove the chat head until the next conversation starts

Android 11 screen recorder

            The screen recorder function lives in the Quick Settings tiles. You tap the Screen Record feature which gives you a few options before you start recording. For example, you can choose whether or not your screen-taps should also be recorded and whether the phone should capture audio, too.

Media controls


                If you are playing music on your Android 10 phone, a music player appears at the top of your notifications drawer. Of course, with Android 11, that section of the drawer is now reserved for conversations, so the media player needed to move. Google decided to move it one rung up to the Quick Settings section.    
                When you swipe down your notification drawer, the media controller will be pretty small. It will show you the app it’s related to, cover art, basic controls, and on which system the media is playing. If you pull down again on the drawer, the alert expands and shows the information

Smart device controls

                Google added a new section in Android 11 that allows you to easily control your various devices without needing to open an app.


                You can hold down the power button to launch the new tool. At the top, you’ll find the usual power features, but underneath, you’ll see a lot more options. There’s a Google Pay shortcut that allows you to quickly choose which payment method you want your next contactless transaction to use. Under that, you’ll see a bunch of buttons connected to your various smart home products.
                
        The Device Controls feature, available starting in Android R, allows the user to quickly view and control external devices such as lights, thermostats, and cameras from the Android power menu. Device aggregators (for example, Google Home) and third-party vendor apps can provide devices for display in this space.​

One-time permissions and auto-reset

            Android 11 gives the user even more control by allowing them to give permissions only for that specific session.
            Similarly, Android 11 will now “auto-reset” apps you haven’t used in a while. If you granted location data permissions to an app that you haven’t opened up in a long time, Android will now revoke all permissions. Next time you open the app, you’ll need to approve those permissions again. 

Dark Theme 

            With Android 11, users can now schedule the dark theme using one of two different metrics. You can schedule a dark theme to turn on or off when the sun sets or rises. You can also set up a custom schedule for dark mode activation if you wish.


Some of the other features are 

Concurrent Camera Streaming Many devices have the hardware capability to stream multiple camera sensors concurrently.

Camera Bokeh : to make the bokeh feature available to third-party apps​

Generic Kernel Image​ : Android R introduces the Generic Kernel Image (GKI), which addresses kernel fragmentation by unifying the core kernel and moving SoC and board support out of the core kernel into loadable modules.​

Device Type Limit​ : In Android R, no limit on the number of audio device types to allow new audio device types to be added​

Soft restarts​ : Android R supports soft restarts, which are runtime restarts of processes in the user space used to apply updates that require a reboot (for example, updates to APEX packages).​

Zombie permissions : Android will automatically revoke an app’s permissions after an undetermined time of inactivity—somewhere between 60 and 90 days. Launching an app within that time reinstates any permissions you’ve granted​

Notification/Sound Muting​ : Device vibration and sounds can hurt image and video quality, especially for cameras with optical image stabilization module​. camera app could use the (DnD) APIs to mute the vibration and sounds
Offline Processing​: Today camera apps must wait for all requests to be fully processed before it can disconnect from the camera or switch to a different configuration, The offline processing API allows the camera HAL to perform post-processing in the background to improve the latency of mode switching or camera closing​

Android 11 updates via Play Store

            Each year, Google releases the latest version of Android. Each month, it pushes out the latest Android security patch. Both of these updates get funneled to your phone either by your carrier or equipment manufacturer. Because of this, some phones get many updates very quickly, while others either get them much slower or not at all.o counteract this, Android 11 gives more power related to updates over to the Google Play Store. This allows Google to bypass carriers and OEMs entirely and push out updates to everyone.

App-pinning to the share sheet

            You can now pin apps to your share sheet in order to easily access them whenever you want to share something.This feature allows you, the user, to control which apps appear at the top of the list when you want to share something.


Improved prediction tools

            Android 11 will seemingly reduce the work you need to do on your phone, by predicting your habits and patterns.
            One such example of this is smart folders, so you can let Android 11 automatically sort your apps into folders of similar apps, like games or productivity tools.
            App suggestions is also tweaked to suggest apps based on your routine - for example, if you always log onto your Fitbit app first thing in the morning to examine your sleep habits, the phone will now automatically pop that app into the Home screen in the morning so it's easily accessible.
            Finally, apparently the Smart Reply feature already usable in Android phones has received some tweaks. This mode suggests some automatic responses when you receive a message, letting you reply with one tap (if any of the responses are appropriate) but it's not clear what's new here.

New phones coming with Android 11

Did you find our blog helpful ? Share in comment section. Feel free to share on Twitter or Facebook by using the share buttons

Share:

Wednesday, November 11, 2020

Virtual Reality devices and its real time applications

          

 
    Over the last few years there has been a large movement to produce virtual reality technology that allows users to experience video and images in an immersive atmosphere right from their home. Many different companies have entered the arena at a wide range of prices and it seems another technological war is on. Each one of the devices on the market, though, gives you an experience like nothing you have had at home before.

VR Devices

            There are a few major brands when it comes to finding virtual reality equipment. Samsung, Google, and Oculus Rift are some of the major competitors. Here are brief descriptions of the products.

Samsung Gear VR

            Samsung offers the Gear VR which is a good headset for being easy to use. It uses Oculus Rift as the backbone for it but connects to a Samsung Galaxy to run and display. There is a slot at the front of the device that allows you to just slide your Samsung Galaxy in. The one major issue with Samsung Gear VR is that it is restrictive, you can only use a Samsung Galaxy phone and apps that support it.

Google Cardboard

            Google may just be one of the most interesting introductions into the VR world. Google found itself challenged by other tech innovators who were releasing expensive VR devices. Half-jokingly, Google decided that it could produce a superior product that cost less and was made out of cardboard. And Google Cardboard was born. Google Cardboard is easy to use and there are a wide variety of different manufacturers out there so you are almost guaranteed to be able to find one that works with your phone. Many of them are universal.
            The amazing part of Google Cardboard is that it is literally made of a piece of cardboard and gives an incredible immersive 3d experience. Similar to the Samsung Gear, you slide your phone in the front of the device and your phone does all the work, splitting the screen in two so your eyes can see in 3d. An entire YouTube channel already exists with 360 degree videos that you can use your head movement to navigate through.
Unlike the Samsung Gear, Google Cardboard will allow you to use any device as long as you install the Cardboard app.

Oculus Rift

            Oculus Rift is the company that Kickstarted their way into the virtual reality world. While other companies had been maintaining a low profile on their VR devices Oculus launched a Kickstarter campaign to create their devices. The campaign was successfully funded but the Rift has been in development and pre-order for years. The expected launch is Q1 of this year.
Some of the other competitors or upcoming competitors include:

How These Devices Will Change The World

            All of these virtual reality devices will no doubt change the gaming and movie industries. Slowly over the next few years you will start to be immersed in entertainment in ways that you never thought were possible. It will take a little bit of time for development and filming to completely switch over VR compatible technology but when it does you will see games and movies as if you were actually there, without outside distractions.
It is going to do more than that though. Here are a few more ways it will change the world:

Real Estate, Design, and Development

            Virtual reality equipment will allow you to see what you are looking at in immersive three definition. That means that you can share real life real estate with people across the world and they can feel like they are actually there, touring the location with you. You can also share your digitally created plans like they are real. Imagine being able to walk around that new floorplan for your home or office before you make any purchases.

Body Swapping

         Scientists at the Imperial College London have been working on a way that you can use VR equipment to feel like you are someone else. Using the goggles you are able to see what someone else sees. Electrical diodes deliver the electrical impulses across your body to allow you to even feel what the other person is feeling. While the system isn't perfect yet, it is amazing technology that could make us be able to literally "walk in someone else's shoes."

Medical Uses

            VR is already being used to treat people around the world for Post-Traumatic Stress Disorder and other mental problems. Virtual reality equipment allows people to confront the issues that are holding them back or causing the stress. It even allows autistic people to learn about social cues and norms. There are also people who are developing ways to use VR technology to practice surgery and other medical procedures.
        These purposes for virtual reality are just starting to scratch the surface in what is possible. As it continues to develop and bugs are worked out the whole world will start to notice the changes from VR technology. Taking us to new worlds, both imagination based and reality based.
Share:

Popular Posts

Contact Form

Name

Email *

Message *