“We developed a deep neural network that maps the phase and amplitude of WiFi signals to UV coordinates within 24 human regions. The results of the study reveal that our model can estimate the dense pose of multiple subjects, with comparable performance to image-based approaches, by utilizing WiFi signals as the only input.”
Also VR nerds. Current tracking is either based on the headset, so you can't move your arms unless the headset can see them, or your arms have to be seen by lighthouses, or you rely purely on gyroscope and accelerometers for tracking, which tend to drift. So either you have blind spots, have to deal with occlusion, or will slowly drift and have to recalibrate periodically. Wifi-based tracking seems like a neat idea tbh.
Edit: considering wifi is just photons that aren't wiggling fast enough for us to see, I'd be surprised if the government doesn't already have this technology behind closed doors.
For VR I don’t see why we wouldn’t use a variety of other technologies before we ever use WiFi. The main issue with the WiFi thing is going to be polling rates and interference (which limits polling rates). They’re also using a neural net here which requires both processing power and time so there’s latency far beyond VR uses. That’s without talking about tracking that would be needed for higher spatial resolution which this also doesn’t have currently.
So it’s not impossible to use this, just not currently practical or even close.
The real solve to that stuff is just an improvement on existing tech or maybe Lidar. With the progress that has been made on the Quest with hand tracking, I’d bet their next goal is body and face tracking so you’ll see this soon.
As for the government having this, I doubt they really need to have it this specific to track poses or body parts. If you have a cell phone on you, they likely know exactly where you’re at in a room. If you don’t, I’m betting they have access to other important data. Motion detection, number of people, room shape and some contents, interference sources.
Home automation nerds would also cream their pants if they could get their hands on this. Imagine you could use your existing wifi router to detect presence in your home. Say goodbye to shitty IR sensors that forget about your existence within 3 seconds, no more finicky radar modules that are either too sensitive or not nearly sensitive enough.
Article is from a year ago. Government tends to be ahead of the curve. As an uninformed guess, they have been using it in high value situations for 4+ years.
(Dear FBI, the above is a guess based on public information. I don't know shit.)
I dunno what world you're living in, but I live in a world where police still do nearly all their work with pencil and paper and if you want to talk to a police officer, no you can't talk to them on the phone or send an email. You'll have to have a meeting face to face.
It's pretty likely that they have shared this system with their closest allies, similar to how the Trophy missile defense system found its way onto German and American tanks.
By the way, those throwable cameras mentioned at the end of the article have been available to the IDF since 2005.
Here's the summary for the wikipedia article you mentioned in your comment:
TEMPEST is a U. S. National Security Agency specification and a NATO certification referring to spying on information systems through leaking emanations, including unintentional radio or electrical signals, sounds, and vibrations. TEMPEST covers both methods to spy upon others and how to shield equipment against such spying. The protection efforts are also known as emission security (EMSEC), which is a subset of communications security (COMSEC).
I am going to repeat myself forever it seems. We got it wrong when we decided that you only have privacy when someone can't physically see what you are up to. Nothing else is treated this way. You are not allowed to drive as fast as your car can physically move. You are not allowed to go into anything locked as long as you are able to pick it. You are not allowed to steal whatever you want as long as no one tackles you for it. And yet somehow some way it became understood that merely because someone can get a photo of you they have the legal right to do so.
As if access to better technology means you should follow less moral rules vs the opposite. Someone with a junk camera of the 80s can do far less perving compared to the new cameras+drones out there.
it became understood that merely because someone can get a photo of you they have the legal right to do so.
What jurisdiction is this true? There are certainly times that there is an expectation of privacy and getting a photo of you would be illegal. Easy example: and owner of a store can't photo you in the dressing room, the even tho they could put a camera in there. It's the same thing here, there is an expectation of privacy in your home (or for many enclosed and private spaces), so this kind of "picture" would likely already be a violation.
I'm an EE, and I have serious doubt about this actually working nearly as good as they are putting it. This sort of stuff is hard, even with purpose built radar systems. I'm working with angle estimation in Multipath environments, and that shit fucks your signals up. This may work it you have extremely precisely characterised the target room and walls, and a ton of stuff around it, and then don't change anything but the motion of the people. But that's not practical.
You are correct, at best this requires some a priori knowledge of the room. You can kind of do basic motion detection blindly though. They are just measuring the channel response via the 802.11 preambles, so for basic presence detection knowing that the channel response is changing is enough.
I was under the impression these experiments required a pre mapped room with EM readings. I don't think they can watch you like if it was an X-ray but I'd believe it if they could track blobs of moving mass.
There are already smart light bulbs you can buy off the shelf that use radio signals to see when somebody is in the room. Then it can turn on the lights automatically, without a camera or infrared sensor in the area.
What we know about drones is that they have cameras that can discern individuals from 10 km altitude.
What we suspect is that US has Hubble-sized spy satellites that can do almost the same. There were a lot of classified military STS missions.
What is theoretically possible is that US drones and spy sats can function as very large arrays (we do this with astronomical telescopes already) to dramatically increase spatial resolution.
The tech is even far older than the article. I remember seeing this being demo'd at least a decade ago. Though, it looks like the fidelity has improved significantly from the early proof-of-concept videos that were floating around for a while.
The reason this is good for privacy is because we don't need a new smart device to send other (like video) data away for heavy processing in the cloud.
We might instead be able to just update wifi routers to create local functionality.
Then it will depend on the router and the user configuration what actually happens with that data.
The user can have full local control…. Except neighbours wifi could be spying and so could someone with a wifi device in a car. But if putting a faraday cage around peoples exterior walls (combined with an underground physical cable to an internal extender for phone and roaming while insid) becomes a thing then it looks it could be a great system theoretically.
Gotta wait to see how it might look in practice though.
I heard that they can analyze window glass to get audio recordings because as a slow moving liquid, vibrations in the air leave an imprint on the glass.
The "glass is a liquid" thing is a myth. The reason why old windows tended to be thicker at the bottom (which is usually the cited reason for this myth) is because windowpane making techniques weren't very good and so they would always have one thicker side. The builders would naturally install the pane with that side on the bottom because it was more stable. Glass doesn't "flow" over time, it's a solid crystallineamorphous material.
They bounce a laser off the glass and can hear what's happening in the room by capturing the vibrations of the glass. I seem to remember the US embassy was caught spying on the Canadian Prime Minister using this technique.
MIT used a high speed camera to reconstruct sound vibrations from objects behind soundproof glass, such as a bag of chips, water in a glass, and a plant. That was in 2014.
Yep I have read that sensitive buildings are now built with a hallway ringing the building and offices further inside, so the rooms where classified things are discussed don't have windows accessible by outside lasers.
Yes that's possible and it has some years but there's some conditions. The glass needs to have a sticker onto it for the trick AFAIK is to reflect a laser or infrared light onto it and track the less than milimétric vibrations of it and depending on where is the sticker and how big is the window it affects the quality of the recording.
Given this wifi trick I think it would have to do with signals not passing through water clearly or some thing on the likes and more over it should need some specific equipment to pull out the trick, I don't imagine you could just hack a router and patch surveillance in the firmware.