Hi Cuong,
As Stefano mentioned you can directly upload the .app file to Sandbox by hitting Ctrl+F5.
In order to build you need to have a launch.json as well as app.json file configured to the right tenant.
After which the package will automatically be deployed to your Sandbox Environment.
When deploying to Production you'll need the .app file and upload the extension.